Sep 21 16:27:53 devstack cinder-volume[75189]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 21 16:27:53 devstack cinder-volume[75189]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 21 16:27:53 devstack cinder-volume[75189]: we strongly recommend against using it for new projects. Sep 21 16:27:53 devstack cinder-volume[75189]: If you are already using Eventlet, we recommend migrating to a different Sep 21 16:27:53 devstack cinder-volume[75189]: framework. For more detail see Sep 21 16:27:53 devstack cinder-volume[75189]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 21 16:27:53 devstack cinder-volume[75189]: import eventlet # noqa Sep 21 16:27:56 devstack cinder-volume[75189]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 16:27:56 devstack cinder-volume[75189]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 16:27:56 devstack cinder-volume[75189]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 16:27:57 devstack cinder-volume[75189]: INFO dbcounter [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Registered counter for database cinder Sep 21 16:27:57 devstack cinder-volume[75189]: DEBUG oslo_db.sqlalchemy.engines [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 16:27:57 devstack cinder-volume[75189]: DEBUG dbcounter [-] [75189] Writer thread running {{(pid=75189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 21 16:27:57 devstack cinder-volume[75189]: INFO cinder.rpc [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 21 16:27:57 devstack cinder-volume[75189]: INFO cinder.rpc [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 21 16:27:57 devstack cinder-volume[75189]: DEBUG oslo_db.sqlalchemy.engines [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 16:27:58 devstack cinder-volume[75189]: INFO cinder.volume.manager [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Determined volume DB was empty at startup. Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG cinder.volume.manager [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75189) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 21 16:27:58 devstack cinder-volume[75189]: INFO cinder.volume.manager [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 21 16:27:58 devstack cinder-volume[75189]: WARNING stevedore.named [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 21 16:27:58 devstack cinder-volume[75189]: WARNING castellan.key_manager [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 16:27:58 devstack cinder-volume[75189]: WARNING cinder.keymgr.conf_key_mgr [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG cinder.volume.drivers.lvm [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75189) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_concurrency.processutils [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_concurrency.processutils [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] CMD "cinder-rtstool verify" returned: 0 in 0.450s {{(pid=75189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_db.sqlalchemy.engines [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 16:27:58 devstack cinder-volume[75189]: INFO cinder.rpc [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 21 16:27:58 devstack cinder-volume[75189]: INFO cinder.rpc [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 21 16:27:58 devstack cinder-volume[75189]: WARNING stevedore.named [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 21 16:27:58 devstack cinder-volume[75189]: WARNING castellan.key_manager [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 16:27:58 devstack cinder-volume[75189]: INFO cinder.volume.manager [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_db.sqlalchemy.engines [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 16:27:58 devstack cinder-volume[75189]: INFO oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Starting 1 workers Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Started child 75379 {{(pid=75189) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Full set of CONF: {{(pid=75189) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] ******************************************************************************** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Configuration options gathered from: {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] ================================================================================ {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] allow_availability_zone_fallback = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] allow_compression_on_image_upload = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] allowed_direct_url_schemes = [] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] api_rate_limit = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] auth_strategy = keystone {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] az_cache_duration = 3600 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_availability_zone = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_host = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_name = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_stats_polling_interval = 60 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backup_api_class = cinder.backup.api.API {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75379]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backup_name_template = backup-%s {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backup_use_same_host = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backup_use_temp_snapshot = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] chap_password = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] chap_username = {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cinder_internal_tenant_project_id = 6b35e2ee546b473f9dc269950d842bfd {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cinder_internal_tenant_user_id = 45eee186905c4e119034e610a5d124cd {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cloned_volume_same_az = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cluster = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] compression_format = gzip {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] compute_api_class = cinder.compute.nova.API {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] config_dir = [] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] config_source = [] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] control_exchange = openstack {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] debug = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] default_availability_zone = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] default_group_type = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] default_volume_type = lvmdriver-1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] disk_geometry = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] driver_client_cert = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] driver_client_cert_key = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] driver_data_namespace = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] driver_ssl_cert_path = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] driver_ssl_cert_verify = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] driver_use_ssl = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] enable_force_upload = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] enable_new_services = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] enable_unsupported_driver = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] enabled_backends = ['lvmdriver-1'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] enforce_multipath_for_image_xfer = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] filter_function = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance_api_insecure = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance_api_servers = ['http://192.168.122.69/image'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance_api_ssl_compression = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance_ca_certificates_file = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance_catalog_info = image:glance:publicURL {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance_certfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance_keyfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance_num_retries = 3 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance_request_timeout = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] goodness_function = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] graceful_shutdown_timeout = 5 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] group_api_class = cinder.group.api.API {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] host = devstack {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] image_compress_on_upload = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] image_conversion_address_space_limit = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] image_conversion_cpu_limit = 60 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] image_conversion_disable = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] image_introspection_address_space_limit = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] image_introspection_cpu_limit = 60 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] image_upload_use_cinder_backend = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] image_upload_use_internal_tenant = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] image_volume_cache_enabled = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] image_volume_cache_max_count = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] image_volume_cache_max_size_gb = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] init_host_max_objects_retrieval = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] instance_format = [instance: %(uuid)s] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] iscsi_target_flags = {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] iscsi_write_cache = on {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] iser_helper = tgtadm {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] iser_ip_address = 192.168.122.69 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] iser_port = 3260 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] log_color = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] log_config_append = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] log_dir = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] log_file = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] log_options = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] log_rotate_interval = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] log_rotate_interval_type = days {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] log_rotation_type = none {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] max_age = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] max_logfile_count = 30 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] max_logfile_size_mb = 200 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] max_over_subscription_ratio = 20.0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] message_reap_interval = 86400 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] message_ttl = 2592000 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] migration_create_volume_timeout_secs = 300 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] monkey_patch = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] monkey_patch_modules = [] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] my_ip = 192.168.122.69 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] no_snapshot_gb_quota = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] num_iser_scan_tries = 3 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] num_shell_tries = 3 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] num_volume_device_scan_tries = 3 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] nvmeof_conn_info_version = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] nvmet_ns_id = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] nvmet_port_id = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] osapi_max_limit = 1000 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] osapi_volume_ext_list = [] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] osapi_volume_listen = 0.0.0.0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] osapi_volume_listen_port = 8776 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] osapi_volume_use_ssl = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] osapi_volume_workers = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] per_volume_size_limit = -1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] periodic_fuzzy_delay = 60 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] periodic_interval = 60 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] project_id_regex = [0-9a-f\-]+ {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] public_endpoint = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] publish_errors = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] quota_backup_gigabytes = 1000 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] quota_backups = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] quota_gigabytes = 1000 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] quota_groups = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] quota_snapshots = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] quota_volumes = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] rate_limit_burst = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] rate_limit_except_level = CRITICAL {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] rate_limit_interval = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] reinit_driver_count = 3 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] replication_device = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] report_discard_supported = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] report_interval = 120 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] reservation_clean_interval = 86400 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] reservation_expire = 86400 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] reserved_image_namespaces = [] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] reserved_percentage = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] rpc_response_timeout = 120 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] run_external_periodic_tasks = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] scst_target_driver = iscsi {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] scst_target_iqn_name = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] service_down_time = 720 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] shell_completion = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] snapshot_name_template = snapshot-%s {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] snapshot_same_host = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] split_loggers = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] state_path = /opt/stack/data/cinder {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] storage_availability_zone = nova {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] storage_protocol = iSCSI {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] syslog_log_facility = LOG_USER {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] target_helper = lioadm {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] target_ip_address = 192.168.122.69 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] target_port = 3260 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] target_protocol = iscsi {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] target_secondary_ip_addresses = [] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] trace_flags = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] transfer_api_class = cinder.transfer.api.API {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] transport_url = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] until_refresh = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] use_chap_auth = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] use_default_quota_class = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] use_journal = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] use_json = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] use_multipath_for_image_xfer = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] use_stderr = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] use_syslog = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] verify_glance_signatures = enabled {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] volume_api_class = cinder.volume.api.API {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] volume_backend_name = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] volume_clear = zero {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75379]: INFO cinder.volume.manager [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] volume_clear_ionice = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] volume_clear_size = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] volume_copy_bps_limit = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] volume_dd_blocksize = 1M {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] volume_name_template = volume-%s {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] volume_service_inithost_offload = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] volume_usage_audit_period = month {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] zoning_mode = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_concurrency.disable_process_locking = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.auth_section = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.auth_type = password {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.auth_version = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.cache = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.certfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.delay_auth_decision = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.http_connect_timeout = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.include_service_catalog = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.insecure = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.interface = public {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.keyfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_password = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcache_username = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.region_name = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.service_token_roles_required = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.service_type = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.token_cache_time = 300 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.69/identity {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.backend = dogpile.cache.null {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.backend_argument = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.backend_expiration_time = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.config_prefix = cache.oslo {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.debug_cache_backend = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.enable_retry_client = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.enable_socket_keepalive = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.enabled = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.expiration_time = 600 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.hashclient_retry_attempts = 2 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.memcache_dead_retry = 300 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.memcache_pool_maxsize = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.memcache_sasl_enabled = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.password = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.proxies = [] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.redis_db = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.redis_sentinel_service_name = mymaster {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.redis_server = localhost:6379 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.retry_attempts = 2 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.retry_delay = 0.0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.socket_keepalive_count = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.socket_keepalive_idle = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.socket_keepalive_interval = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.socket_timeout = 1.0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.tls_allowed_ciphers = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.tls_cafile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.tls_certfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.tls_enabled = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.tls_keyfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cache.username = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] coordination.backend_url = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.asyncio_connection = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.asyncio_slave_connection = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.backend = sqlalchemy {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.connection = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.connection_debug = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.connection_parameters = {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.connection_recycle_time = 3600 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.connection_trace = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.db_inc_retry_interval = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.db_max_retries = 20 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.db_max_retry_interval = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.db_retry_interval = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.max_overflow = 50 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.max_pool_size = 5 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.max_retries = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.mysql_wsrep_sync_wait = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.pool_timeout = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.retry_interval = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.slave_connection = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.sqlite_synchronous = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.synchronous_reader = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] database.use_db_reconnect = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_tracing.insecure = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler.connection_string = messaging:// {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler.enabled = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler.es_doc_type = notification {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler.es_scroll_size = 10000 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler.es_scroll_time = 2m {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler.filter_error_trace = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler.hmac_keys = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler.sentinel_service_name = mymaster {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler.socket_timeout = 0.1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler.trace_requests = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler.trace_sqlalchemy = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler_jaeger.process_tags = {} {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler_jaeger.service_name_prefix = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] profiler_otlp.service_name_prefix = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_policy.enforce_new_defaults = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_policy.policy_default_rule = default {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_policy.policy_file = policy.yaml {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_policy.remote_timeout = 60.0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] privsep_osbrick.group = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] privsep_osbrick.helper_command = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] privsep_osbrick.user = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cinder_sys_admin.group = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cinder_sys_admin.helper_command = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] cinder_sys_admin.user = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] service_user.auth_section = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] service_user.auth_type = password {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] service_user.cafile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] service_user.certfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] service_user.collect_timing = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] service_user.insecure = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] service_user.keyfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] service_user.send_service_user_token = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] service_user.split_loggers = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] service_user.timeout = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] service_user.tls_ciphers = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] service_user.tls_min_version = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance.auth_section = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance.auth_type = password {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance.certfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance.collect_timing = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance.insecure = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance.keyfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance.region_name = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance.split_loggers = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance.timeout = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance.tls_ciphers = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] glance.tls_min_version = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.backend_availability_zone = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.chap_password = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.chap_username = {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.disk_geometry = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.driver_client_cert = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.driver_client_cert_key = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.driver_data_namespace = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.driver_use_ssl = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.enable_unsupported_driver = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.extra_capabilities = {} {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.filter_function = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.goodness_function = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.iscsi_target_flags = {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.iscsi_write_cache = on {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.iser_helper = tgtadm {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.iser_ip_address = 192.168.122.69 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.iser_port = 3260 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.lvm_mirrors = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.lvm_share_target = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.lvm_type = auto {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.num_shell_tries = 3 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.nvmet_port_id = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.replication_device = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.report_discard_supported = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.reserved_percentage = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.scst_target_driver = iscsi {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.scst_target_iqn_name = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.storage_protocol = iSCSI {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.target_helper = tgtadm {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.target_ip_address = 192.168.122.69 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.target_port = 3260 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.target_protocol = iscsi {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.trace_flags = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.unique_fqdn_network = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.use_chap_auth = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.volume_backend_name = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.volume_clear = zero {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.volume_clear_ionice = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.volume_clear_size = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.volume_group = cinder-volumes {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_reports.file_event_handler = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_reports.log_dir = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.backend_availability_zone = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.backend_host = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.chap_password = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.chap_username = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.chiscsi_conf = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.disk_geometry = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.driver_client_cert = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.driver_data_namespace = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.driver_use_ssl = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.extra_capabilities = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.filter_function = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.goodness_function = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.iser_helper = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.iser_ip_address = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.iser_port = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.iser_target_prefix = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.lvm_conf_file = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.lvm_mirrors = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.lvm_share_target = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.lvm_type = auto {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.num_shell_tries = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.nvmet_port_id = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.replication_device = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.report_discard_supported = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.reserved_percentage = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.scst_target_driver = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.storage_protocol = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.target_helper = lioadm {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.target_ip_address = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.target_port = 3260 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.target_protocol = iscsi {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.trace_flags = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.use_chap_auth = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.volume_clear = zero {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.volume_clear_size = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] lvmdriver-1.volumes_dir = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.ssl = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.ssl_version = {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_notifications.driver = [] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_notifications.retry = -1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] oslo_messaging_notifications.transport_url = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] key_manager.fixed_key = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:27:58 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.barbican_api_version = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.barbican_endpoint = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.barbican_endpoint_type = public {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.barbican_region_name = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.cafile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.certfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.collect_timing = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.insecure = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.keyfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.number_of_retries = 60 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.retry_delay = 1 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.send_service_user_token = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.split_loggers = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.timeout = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.tls_ciphers = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.tls_min_version = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.verify_ssl = True {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican.verify_ssl_path = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican_service_user.auth_section = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican_service_user.auth_type = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican_service_user.cafile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican_service_user.certfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican_service_user.collect_timing = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican_service_user.insecure = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican_service_user.keyfile = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican_service_user.split_loggers = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican_service_user.timeout = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican_service_user.tls_ciphers = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] barbican_service_user.tls_min_version = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.approle_role_id = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.approle_secret_id = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.auth_method = approle {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.auth_path = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.kv_mountpoint = secret {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.kv_path = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.kv_version = 2 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.namespace = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.root_token_id = **** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.ssl_ca_crt_file = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.timeout = 60.0 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.token_file = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.token_role = None {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack sudo[75386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 21 16:27:58 devstack sudo[75386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.use_ssl = False {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:27:58 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] ******************************************************************************** {{(pid=75189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 21 16:27:59 devstack sudo[75386]: pam_unix(sudo:session): session closed for user root Sep 21 16:27:59 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:27:59 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:27:59 devstack sudo[75467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 16:27:59 devstack sudo[75467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:27:59 devstack sudo[75467]: pam_unix(sudo:session): session closed for user root Sep 21 16:27:59 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.257s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:27:59 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:27:59 devstack cinder-volume[75379]: INFO cinder.brick.local_dev.lvm [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 21 16:27:59 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:27:59 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:27:59 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:27:59 devstack sudo[75578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 16:27:59 devstack sudo[75578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:27:59 devstack sudo[75578]: pam_unix(sudo:session): session closed for user root Sep 21 16:27:59 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:27:59 devstack cinder-volume[75379]: DEBUG cinder.brick.local_dev.lvm [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75379) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 21 16:27:59 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:27:59 devstack sudo[75661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 16:27:59 devstack sudo[75661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:00 devstack sudo[75661]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:00 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.498s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:00 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:00 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:00 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:00 devstack sudo[75841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 16:28:00 devstack sudo[75841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:00 devstack sudo[75841]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:00 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:00 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:00 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:00 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:00 devstack sudo[75913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 21 16:28:00 devstack sudo[75913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:00 devstack sudo[75913]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:00 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.306s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:00 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:00 devstack sudo[75991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 16:28:00 devstack sudo[75991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:01 devstack sudo[75991]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:01 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:01 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:01 devstack sudo[75999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 16:28:01 devstack sudo[75999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:01 devstack sudo[75999]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:01 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:01 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:01 devstack sudo[76077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:28:01 devstack sudo[76077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:01 devstack sudo[76077]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:01 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:01 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:01 devstack sudo[76086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 16:28:01 devstack sudo[76086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:02 devstack sudo[76086]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:02 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.337s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:02 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:02 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:02 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:02 devstack sudo[76170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 16:28:02 devstack sudo[76170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:02 devstack sudo[76170]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:02 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:02 devstack cinder-volume[75379]: INFO cinder.volume.drivers.lvm [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 21 16:28:02 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:02 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:02 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:02 devstack sudo[76180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 16:28:02 devstack sudo[76180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:02 devstack sudo[76180]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:02 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:02 devstack cinder-volume[75379]: DEBUG cinder.volume.drivers.lvm [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Updating volume stats {{(pid=75379) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 21 16:28:02 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:02 devstack sudo[76183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 16:28:02 devstack sudo[76183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:02 devstack sudo[76183]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:02 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:02 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:02 devstack sudo[76186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:28:02 devstack sudo[76186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:03 devstack sudo[76186]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:03 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.234s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:03 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:03 devstack sudo[76189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 16:28:03 devstack sudo[76189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:03 devstack sudo[76189]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:03 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:03 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:03 devstack sudo[76193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:28:03 devstack sudo[76193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:03 devstack sudo[76193]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:03 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:03 devstack cinder-volume[75379]: INFO cinder.volume.driver [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Driver hasn't implemented _init_vendor_properties() Sep 21 16:28:03 devstack cinder-volume[75379]: DEBUG cinder.volume.driver [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75379) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 21 16:28:03 devstack cinder-volume[75379]: DEBUG oslo_db.sqlalchemy.engines [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75379) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 16:28:03 devstack cinder-volume[75379]: DEBUG dbcounter [-] [75379] Writer thread running {{(pid=75379) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 21 16:28:03 devstack cinder-volume[75379]: DEBUG cinder.db.api [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Building query based on filter {{(pid=75379) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 21 16:28:03 devstack cinder-volume[75379]: DEBUG cinder.image.image_utils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75379) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 21 16:28:03 devstack cinder-volume[75379]: INFO cinder.keymgr.migration [None req-177c3e1d-7819-42b6-a3fd-b14bb53a360f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 21 16:28:03 devstack cinder-volume[75379]: DEBUG cinder.volume.drivers.lvm [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Updating volume stats {{(pid=75379) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 21 16:28:03 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:03 devstack sudo[76196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 16:28:03 devstack sudo[76196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:04 devstack sudo[76196]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:04 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:04 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:04 devstack sudo[76199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:28:04 devstack sudo[76199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:04 devstack sudo[76199]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:04 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.235s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:04 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:04 devstack sudo[76204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 16:28:04 devstack sudo[76204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:04 devstack sudo[76204]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:04 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:04 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:04 devstack sudo[76207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:28:04 devstack sudo[76207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:04 devstack sudo[76207]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:04 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:04 devstack cinder-volume[75379]: DEBUG cinder.manager [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Notifying Schedulers of capabilities ... {{(pid=75379) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:28:04 devstack cinder-volume[75379]: INFO cinder.volume.manager [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Driver initialization completed successfully. Sep 21 16:28:04 devstack cinder-volume[75379]: INFO cinder.manager [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Initiating service 2 cleanup Sep 21 16:28:04 devstack cinder-volume[75379]: INFO cinder.manager [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Service 2 cleanup completed. Sep 21 16:28:04 devstack cinder-volume[75379]: DEBUG cinder.service [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Creating RPC server for service cinder-volume {{(pid=75379) start /opt/stack/cinder/cinder/service.py:231}} Sep 21 16:28:04 devstack cinder-volume[75379]: DEBUG cinder.service [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75379) start /opt/stack/cinder/cinder/service.py:237}} Sep 21 16:28:04 devstack cinder-volume[75379]: INFO cinder.volume.manager [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 21 16:28:04 devstack cinder-volume[75379]: DEBUG cinder.volume.drivers.lvm [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Updating volume stats {{(pid=75379) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 21 16:28:04 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:05 devstack sudo[76210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 16:28:05 devstack sudo[76210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:05 devstack sudo[76210]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:05 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:05 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:05 devstack sudo[76213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:28:05 devstack sudo[76213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:05 devstack sudo[76213]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:05 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:05 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:05 devstack sudo[76221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 16:28:05 devstack sudo[76221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:05 devstack sudo[76221]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:05 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:05 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:28:05 devstack sudo[76224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:28:05 devstack sudo[76224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:28:06 devstack sudo[76224]: pam_unix(sudo:session): session closed for user root Sep 21 16:28:06 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:28:06 devstack cinder-volume[75379]: INFO cinder.volume.manager [None req-0a52acca-8f21-4230-b6de-dc89b42e9569 None None] Driver post RPC initialization completed successfully. Sep 21 16:28:08 devstack cinder-volume[75189]: DEBUG dbcounter [-] [75189] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:28:16 devstack cinder-volume[75379]: DEBUG dbcounter [-] [75379] Writing DB stats cinder:SELECT=5 {{(pid=75379) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:28:16 devstack cinder-volume[75379]: DEBUG dbcounter [-] [75379] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75379) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:28:29 devstack cinder-volume[75379]: DEBUG oslo_service.periodic_task [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running periodic task VolumeManager._thread_info {{(pid=75379) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:28:29 devstack cinder-volume[75379]: DEBUG cinder.volume.manager [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] thread count: 6 {{(pid=75379) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:28:29 devstack cinder-volume[75379]: DEBUG cinder.volume.manager [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] thread info: [<_MainThread(MainThread, started 124725653291136)>, , , , , ] {{(pid=75379) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:29:29 devstack cinder-volume[75379]: DEBUG oslo_service.periodic_task [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75379) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:29:29 devstack cinder-volume[75379]: DEBUG cinder.volume.drivers.lvm [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Updating volume stats {{(pid=75379) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 21 16:29:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:29:29 devstack sudo[78865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 16:29:29 devstack sudo[78865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:29:29 devstack sudo[78865]: pam_unix(sudo:session): session closed for user root Sep 21 16:29:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:29:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:29:29 devstack sudo[78868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:29:29 devstack sudo[78868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:29:29 devstack sudo[78868]: pam_unix(sudo:session): session closed for user root Sep 21 16:29:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:29:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:29:29 devstack sudo[78871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 16:29:29 devstack sudo[78871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:29:29 devstack sudo[78871]: pam_unix(sudo:session): session closed for user root Sep 21 16:29:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:29:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:29:29 devstack sudo[78874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:29:29 devstack sudo[78874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:29:30 devstack sudo[78874]: pam_unix(sudo:session): session closed for user root Sep 21 16:29:30 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:29:30 devstack cinder-volume[75379]: DEBUG cinder.manager [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Notifying Schedulers of capabilities ... {{(pid=75379) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:29:30 devstack cinder-volume[75379]: DEBUG oslo_service.periodic_task [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running periodic task VolumeManager._thread_info {{(pid=75379) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:29:30 devstack cinder-volume[75379]: DEBUG cinder.volume.manager [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] thread count: 6 {{(pid=75379) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:29:30 devstack cinder-volume[75379]: DEBUG cinder.volume.manager [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] thread info: [<_MainThread(MainThread, started 124725653291136)>, , , , , ] {{(pid=75379) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:30:16 devstack cinder-volume[75379]: DEBUG dbcounter [-] [75379] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75379) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:30:29 devstack cinder-volume[75379]: DEBUG oslo_service.periodic_task [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75379) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:30:29 devstack cinder-volume[75379]: DEBUG cinder.volume.drivers.lvm [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Updating volume stats {{(pid=75379) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 21 16:30:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:30:29 devstack sudo[82112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 16:30:29 devstack sudo[82112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:30:29 devstack sudo[82112]: pam_unix(sudo:session): session closed for user root Sep 21 16:30:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:30:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:30:29 devstack sudo[82117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:30:29 devstack sudo[82117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:30:29 devstack sudo[82117]: pam_unix(sudo:session): session closed for user root Sep 21 16:30:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:30:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:30:29 devstack sudo[82137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 16:30:29 devstack sudo[82137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:30:29 devstack sudo[82137]: pam_unix(sudo:session): session closed for user root Sep 21 16:30:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:30:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:30:29 devstack sudo[82140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:30:29 devstack sudo[82140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:30:30 devstack sudo[82140]: pam_unix(sudo:session): session closed for user root Sep 21 16:30:30 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:30:30 devstack cinder-volume[75379]: DEBUG cinder.manager [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Notifying Schedulers of capabilities ... {{(pid=75379) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:30:30 devstack cinder-volume[75379]: DEBUG oslo_service.periodic_task [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running periodic task VolumeManager._thread_info {{(pid=75379) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:30:30 devstack cinder-volume[75379]: DEBUG cinder.volume.manager [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] thread count: 6 {{(pid=75379) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:30:30 devstack cinder-volume[75379]: DEBUG cinder.volume.manager [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] thread info: [<_MainThread(MainThread, started 124725653291136)>, , , , , ] {{(pid=75379) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:31:29 devstack cinder-volume[75379]: DEBUG oslo_service.periodic_task [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75379) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:31:29 devstack cinder-volume[75379]: DEBUG cinder.volume.drivers.lvm [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Updating volume stats {{(pid=75379) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 21 16:31:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:31:29 devstack sudo[84071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 16:31:29 devstack sudo[84071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:31:29 devstack sudo[84071]: pam_unix(sudo:session): session closed for user root Sep 21 16:31:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:31:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:31:29 devstack sudo[84082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:31:29 devstack sudo[84082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:31:29 devstack sudo[84082]: pam_unix(sudo:session): session closed for user root Sep 21 16:31:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:31:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:31:29 devstack sudo[84114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 16:31:29 devstack sudo[84114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:31:29 devstack sudo[84114]: pam_unix(sudo:session): session closed for user root Sep 21 16:31:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:31:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:31:29 devstack sudo[84149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:31:29 devstack sudo[84149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:31:30 devstack sudo[84149]: pam_unix(sudo:session): session closed for user root Sep 21 16:31:30 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:31:30 devstack cinder-volume[75379]: DEBUG cinder.manager [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Notifying Schedulers of capabilities ... {{(pid=75379) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:32:16 devstack cinder-volume[75379]: DEBUG dbcounter [-] [75379] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75379) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:32:28 devstack cinder-volume[75189]: INFO oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Caught SIGTERM, stopping children Sep 21 16:32:28 devstack cinder-volume[75189]: DEBUG oslo_concurrency.lockutils [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Acquiring lock "singleton_lock" {{(pid=75189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 16:32:28 devstack cinder-volume[75189]: DEBUG oslo_concurrency.lockutils [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Acquired lock "singleton_lock" {{(pid=75189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 16:32:28 devstack cinder-volume[75189]: DEBUG oslo_concurrency.lockutils [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Releasing lock "singleton_lock" {{(pid=75189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 16:32:28 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Stop services. {{(pid=75189) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 21 16:32:28 devstack cinder-volume[75189]: DEBUG oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Killing children. {{(pid=75189) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 21 16:32:28 devstack cinder-volume[75189]: INFO oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Waiting on 1 children to exit Sep 21 16:32:29 devstack cinder-volume[75379]: DEBUG oslo_service.periodic_task [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75379) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:32:29 devstack cinder-volume[75379]: DEBUG cinder.volume.drivers.lvm [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Updating volume stats {{(pid=75379) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 21 16:32:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:29 devstack sudo[85360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 16:32:29 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:32:29 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root Sep 21 16:32:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:29 devstack sudo[85363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:32:29 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:32:29 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root Sep 21 16:32:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:29 devstack sudo[85366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 16:32:29 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:32:29 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root Sep 21 16:32:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:29 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:29 devstack sudo[85369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 16:32:29 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:32:30 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root Sep 21 16:32:30 devstack cinder-volume[75379]: DEBUG oslo_concurrency.processutils [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75379) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:30 devstack cinder-volume[75379]: DEBUG cinder.manager [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Notifying Schedulers of capabilities ... {{(pid=75379) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:32:30 devstack cinder-volume[75379]: DEBUG oslo_service.periodic_task [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] Running periodic task VolumeManager._thread_info {{(pid=75379) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:32:30 devstack cinder-volume[75379]: DEBUG cinder.volume.manager [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] thread count: 5 {{(pid=75379) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:32:30 devstack cinder-volume[75379]: DEBUG cinder.volume.manager [None req-1e549e9d-0cc9-447b-854d-a05fffe7bae6 None None] thread info: [<_MainThread(MainThread, started 124725653291136)>, , , , ] {{(pid=75379) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:32:30 devstack cinder-volume[75379]: DEBUG oslo_concurrency.lockutils [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Acquiring lock "singleton_lock" {{(pid=75379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 16:32:30 devstack cinder-volume[75379]: DEBUG oslo_concurrency.lockutils [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Acquired lock "singleton_lock" {{(pid=75379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 16:32:30 devstack cinder-volume[75379]: DEBUG oslo_concurrency.lockutils [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Releasing lock "singleton_lock" {{(pid=75379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 16:32:30 devstack cinder-volume[75379]: WARNING amqp [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 21 16:32:30 devstack cinder-volume[75379]: WARNING amqp [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 21 16:32:30 devstack cinder-volume[75189]: INFO oslo_service.backend._eventlet.service [None req-6967e970-bc06-42e0-81bf-0f0ec8b4ff7c None None] Child 75379 exited with status 0 Sep 21 16:32:30 devstack cinder-volume[85373]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 21 16:32:30 devstack cinder-volume[85373]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 21 16:32:30 devstack cinder-volume[85373]: we strongly recommend against using it for new projects. Sep 21 16:32:30 devstack cinder-volume[85373]: If you are already using Eventlet, we recommend migrating to a different Sep 21 16:32:30 devstack cinder-volume[85373]: framework. For more detail see Sep 21 16:32:30 devstack cinder-volume[85373]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 21 16:32:30 devstack cinder-volume[85373]: import eventlet # noqa Sep 21 16:32:32 devstack cinder-volume[85373]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85373) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 16:32:32 devstack cinder-volume[85373]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85373) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 16:32:32 devstack cinder-volume[85373]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85373) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 16:32:33 devstack cinder-volume[85373]: INFO dbcounter [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Registered counter for database cinder Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_db.sqlalchemy.engines [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85373) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG dbcounter [-] [85373] Writer thread running {{(pid=85373) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 21 16:32:33 devstack cinder-volume[85373]: INFO cinder.rpc [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 21 16:32:33 devstack cinder-volume[85373]: INFO cinder.rpc [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_db.sqlalchemy.engines [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85373) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 16:32:33 devstack cinder-volume[85373]: INFO cinder.volume.manager [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Determined volume DB was empty at startup. Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG cinder.volume.manager [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85373) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 21 16:32:33 devstack cinder-volume[85373]: INFO cinder.volume.manager [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 21 16:32:33 devstack cinder-volume[85373]: WARNING stevedore.named [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 21 16:32:33 devstack cinder-volume[85373]: WARNING castellan.key_manager [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 16:32:33 devstack cinder-volume[85373]: WARNING cinder.keymgr.conf_key_mgr [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 16:32:33 devstack cinder-volume[85373]: INFO cinder.volume.manager [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_db.sqlalchemy.engines [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85373) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 16:32:33 devstack cinder-volume[85373]: INFO oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Starting 1 workers Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Started child 85585 {{(pid=85373) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Full set of CONF: {{(pid=85373) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] ******************************************************************************** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Configuration options gathered from: {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] ================================================================================ {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] allow_availability_zone_fallback = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85585]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] allow_compression_on_image_upload = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] allowed_direct_url_schemes = [] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] api_rate_limit = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] auth_strategy = keystone {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_availability_zone = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_host = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_name = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_stats_polling_interval = 60 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backup_api_class = cinder.backup.api.API {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backup_name_template = backup-%s {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backup_use_same_host = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backup_use_temp_snapshot = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] chap_password = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] chap_username = {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cinder_internal_tenant_project_id = 6b35e2ee546b473f9dc269950d842bfd {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cinder_internal_tenant_user_id = 45eee186905c4e119034e610a5d124cd {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cluster = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] compression_format = gzip {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] compute_api_class = cinder.compute.nova.API {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] config_dir = [] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] config_source = [] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] control_exchange = openstack {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] debug = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] default_availability_zone = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] default_group_type = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] default_volume_type = QuobyteHD {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] disk_geometry = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] driver_client_cert = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] driver_client_cert_key = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] driver_data_namespace = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] driver_ssl_cert_path = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:33 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] driver_ssl_cert_verify = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] driver_use_ssl = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] enable_new_services = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] enable_unsupported_driver = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] enabled_backends = ['QuobyteHD'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] enforce_multipath_for_image_xfer = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] filter_function = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance_api_insecure = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance_api_servers = ['http://192.168.122.69/image'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance_api_ssl_compression = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance_ca_certificates_file = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance_catalog_info = image:glance:publicURL {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance_certfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance_keyfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance_num_retries = 3 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance_request_timeout = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] goodness_function = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] graceful_shutdown_timeout = 5 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] group_api_class = cinder.group.api.API {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] host = devstack {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] image_compress_on_upload = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] image_conversion_address_space_limit = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] image_conversion_cpu_limit = 60 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] image_conversion_disable = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] image_introspection_address_space_limit = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] image_introspection_cpu_limit = 60 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] image_upload_use_cinder_backend = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] image_upload_use_internal_tenant = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] image_volume_cache_enabled = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] image_volume_cache_max_count = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] image_volume_cache_max_size_gb = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] init_host_max_objects_retrieval = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] instance_format = [instance: %(uuid)s] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] iscsi_target_flags = {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] iscsi_write_cache = on {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] iser_helper = tgtadm {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] iser_ip_address = 192.168.122.69 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] iser_port = 3260 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] log_color = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] log_config_append = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] log_dir = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] log_file = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] log_options = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] log_rotate_interval = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] log_rotate_interval_type = days {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] log_rotation_type = none {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] max_age = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] max_logfile_count = 30 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] max_logfile_size_mb = 200 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] max_over_subscription_ratio = 20.0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] message_reap_interval = 86400 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85585]: INFO cinder.volume.manager [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG cinder.volume.drivers.remotefs [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85585) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] message_ttl = 2592000 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] migration_create_volume_timeout_secs = 300 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] monkey_patch = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] monkey_patch_modules = [] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] my_ip = 192.168.122.69 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] no_snapshot_gb_quota = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] num_iser_scan_tries = 3 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] num_shell_tries = 3 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] num_volume_device_scan_tries = 3 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] nvmeof_conn_info_version = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] nvmet_ns_id = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] nvmet_port_id = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] osapi_max_limit = 1000 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] osapi_volume_ext_list = [] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] osapi_volume_listen_port = 8776 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] osapi_volume_use_ssl = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] osapi_volume_workers = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] per_volume_size_limit = -1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] periodic_fuzzy_delay = 60 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] periodic_interval = 60 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] public_endpoint = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] publish_errors = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] quota_backup_gigabytes = 1000 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] quota_backups = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] quota_gigabytes = 1000 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] quota_groups = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] quota_snapshots = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] quota_volumes = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] rate_limit_burst = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] rate_limit_except_level = CRITICAL {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] rate_limit_interval = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] reinit_driver_count = 3 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] replication_device = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] report_discard_supported = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] report_interval = 120 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] reservation_clean_interval = 86400 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] reservation_expire = 86400 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] reserved_image_namespaces = [] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] reserved_percentage = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] rpc_response_timeout = 120 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] run_external_periodic_tasks = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] scst_target_driver = iscsi {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] scst_target_iqn_name = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] service_down_time = 720 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] shell_completion = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] snapshot_name_template = snapshot-%s {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] split_loggers = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] state_path = /opt/stack/data/cinder {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] storage_availability_zone = nova {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] storage_protocol = iSCSI {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] syslog_log_facility = LOG_USER {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] target_helper = lioadm {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] target_ip_address = 192.168.122.69 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] target_port = 3260 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] target_protocol = iscsi {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] target_secondary_ip_addresses = [] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] trace_flags = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] transport_url = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] until_refresh = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] use_chap_auth = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] use_default_quota_class = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] use_journal = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] use_json = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] use_multipath_for_image_xfer = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] use_stderr = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] use_syslog = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] verify_glance_signatures = enabled {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] volume_api_class = cinder.volume.api.API {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] volume_backend_name = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] volume_clear = zero {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] volume_clear_ionice = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] volume_clear_size = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] volume_copy_bps_limit = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] volume_dd_blocksize = 1M {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] volume_name_template = volume-%s {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] volume_service_inithost_offload = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] volume_usage_audit_period = month {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] zoning_mode = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_concurrency.disable_process_locking = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.auth_section = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.auth_type = password {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.auth_version = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.cache = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.certfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.include_service_catalog = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.insecure = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.interface = public {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.keyfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_password = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcache_username = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.region_name = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.service_type = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.69/identity {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.backend = dogpile.cache.null {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.backend_argument = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.backend_expiration_time = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.config_prefix = cache.oslo {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.debug_cache_backend = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.enable_retry_client = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.enable_socket_keepalive = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.enabled = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.expiration_time = 600 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.hashclient_retry_attempts = 2 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.memcache_dead_retry = 300 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.memcache_pool_maxsize = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG cinder.volume.drivers.quobyte [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85585) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 21 16:32:34 devstack cinder-volume[85585]: WARNING cinder.volume.drivers.quobyte [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.memcache_sasl_enabled = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.password = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.proxies = [] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.redis_db = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85585]: WARNING cinder.volume.drivers.quobyte [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG oslo_concurrency.processutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Running cmd (subprocess): mount.quobyte {{(pid=85585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.redis_server = localhost:6379 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.retry_attempts = 2 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.retry_delay = 0.0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.socket_keepalive_count = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.socket_keepalive_idle = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.socket_keepalive_interval = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.socket_timeout = 1.0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.tls_allowed_ciphers = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.tls_cafile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.tls_certfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.tls_enabled = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.tls_keyfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cache.username = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] coordination.backend_url = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.asyncio_connection = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.asyncio_slave_connection = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.backend = sqlalchemy {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.connection = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.connection_debug = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.connection_parameters = {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.connection_recycle_time = 3600 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.connection_trace = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.db_inc_retry_interval = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.db_max_retries = 20 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.db_max_retry_interval = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.db_retry_interval = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.max_overflow = 50 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.max_pool_size = 5 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.max_retries = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.mysql_wsrep_sync_wait = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.pool_timeout = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.retry_interval = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.slave_connection = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.sqlite_synchronous = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.synchronous_reader = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] database.use_db_reconnect = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_tracing.insecure = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler.connection_string = messaging:// {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler.enabled = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler.es_doc_type = notification {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler.es_scroll_size = 10000 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler.es_scroll_time = 2m {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler.filter_error_trace = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler.hmac_keys = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler.sentinel_service_name = mymaster {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler.socket_timeout = 0.1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler.trace_requests = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler.trace_sqlalchemy = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler_jaeger.process_tags = {} {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler_jaeger.service_name_prefix = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] profiler_otlp.service_name_prefix = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_policy.enforce_new_defaults = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_policy.policy_default_rule = default {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_policy.policy_file = policy.yaml {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] privsep_osbrick.group = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] privsep_osbrick.helper_command = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] privsep_osbrick.user = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cinder_sys_admin.group = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cinder_sys_admin.helper_command = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] cinder_sys_admin.user = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] service_user.auth_section = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] service_user.auth_type = password {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] service_user.cafile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] service_user.certfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] service_user.collect_timing = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] service_user.insecure = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] service_user.keyfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] service_user.send_service_user_token = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] service_user.split_loggers = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] service_user.timeout = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] service_user.tls_ciphers = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] service_user.tls_min_version = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance.auth_section = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance.auth_type = password {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance.certfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance.collect_timing = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance.insecure = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance.keyfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance.region_name = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance.split_loggers = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance.timeout = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance.tls_ciphers = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] glance.tls_min_version = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.backend_availability_zone = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.chap_password = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.chap_username = {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.disk_geometry = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.driver_client_cert = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.driver_client_cert_key = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.driver_data_namespace = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.driver_use_ssl = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.extra_capabilities = {} {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.filter_function = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.goodness_function = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.iscsi_target_flags = {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.iscsi_write_cache = on {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.iser_helper = tgtadm {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.iser_ip_address = 192.168.122.69 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.iser_port = 3260 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.nas_host = {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.nas_login = admin {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.nas_mount_options = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.nas_password = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.nas_private_key = {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.nas_share_path = {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.num_shell_tries = 3 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.quobyte_volume_url = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.replication_device = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.report_discard_supported = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.reserved_percentage = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.target_helper = tgtadm {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.target_ip_address = 192.168.122.69 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.target_port = 3260 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.target_protocol = iscsi {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.trace_flags = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.unique_fqdn_network = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.use_chap_auth = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.volume_backend_name = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.volume_clear = zero {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.volume_clear_ionice = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.volume_clear_size = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_reports.file_event_handler = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_reports.log_dir = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.backend_availability_zone = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.backend_host = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.chap_password = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.chap_username = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.chiscsi_conf = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.disk_geometry = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.driver_client_cert = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.driver_data_namespace = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.driver_use_ssl = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.extra_capabilities = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.filter_function = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.goodness_function = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG oslo_concurrency.processutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] CMD "mount.quobyte" returned: 1 in 0.090s {{(pid=85585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG cinder.volume.drivers.quobyte [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=85585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.iser_helper = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.iser_ip_address = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.iser_port = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.iser_target_prefix = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85585]: INFO cinder.volume.drivers.quobyte [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad ... Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.nas_host = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG oslo_concurrency.processutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 -c /etc/quobyte/client-cinder.cfg {{(pid=85585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.nas_login = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.nas_mount_options = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.nas_password = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.nas_private_key = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.nas_share_path = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.nas_ssh_port = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.num_shell_tries = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack sudo[85591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 -c /etc/quobyte/client-cinder.cfg Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.nvmet_port_id = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.replication_device = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.report_discard_supported = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.reserved_percentage = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.scst_target_driver = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.storage_protocol = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.target_helper = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.target_ip_address = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.target_port = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.target_prefix = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.target_protocol = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.trace_flags = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.use_chap_auth = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.volume_clear = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.volume_clear_size = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] QuobyteHD.volumes_dir = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.ssl = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_notifications.driver = [] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_notifications.retry = -1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] key_manager.fixed_key = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.barbican_api_version = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.barbican_endpoint = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.barbican_endpoint_type = public {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.barbican_region_name = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.cafile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.certfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.collect_timing = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.insecure = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.keyfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.number_of_retries = 60 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.retry_delay = 1 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.send_service_user_token = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.split_loggers = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.timeout = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.tls_ciphers = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.tls_min_version = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.verify_ssl = True {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican.verify_ssl_path = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican_service_user.auth_section = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican_service_user.auth_type = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican_service_user.cafile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican_service_user.certfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican_service_user.collect_timing = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican_service_user.insecure = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican_service_user.keyfile = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican_service_user.split_loggers = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican_service_user.timeout = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican_service_user.tls_ciphers = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] barbican_service_user.tls_min_version = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.approle_role_id = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.approle_secret_id = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.auth_method = approle {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.auth_path = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.kv_mountpoint = secret {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.kv_path = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.kv_version = 2 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.namespace = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.root_token_id = **** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.ssl_ca_crt_file = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.timeout = 60.0 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.token_file = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.token_role = None {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.use_ssl = False {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:34 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] ******************************************************************************** {{(pid=85373) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 21 16:32:34 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG oslo_concurrency.processutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.417s {{(pid=85585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:34 devstack cinder-volume[85585]: INFO cinder.volume.drivers.quobyte [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad succeeded Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG cinder.volume.drivers.quobyte [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=85585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.430s {{(pid=85585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG oslo_concurrency.processutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=85585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:34 devstack sudo[85690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:32:34 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:32:34 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG oslo_concurrency.processutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.251s {{(pid=85585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:34 devstack cinder-volume[85585]: INFO cinder.volume.driver [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Driver hasn't implemented _init_vendor_properties() Sep 21 16:32:34 devstack cinder-volume[85585]: DEBUG cinder.volume.driver [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6392135620117, 'free_capacity_gb': 1775.6392135620117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85585) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG oslo_db.sqlalchemy.engines [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG dbcounter [-] [85585] Writer thread running {{(pid=85585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG cinder.db.api [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Building query based on filter {{(pid=85585) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG cinder.image.image_utils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85585) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 21 16:32:35 devstack cinder-volume[85585]: INFO cinder.keymgr.migration [None req-8301cc7d-6bd8-4317-9e76-c9e9968b97cc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG cinder.volume.drivers.quobyte [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=85585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG cinder.volume.drivers.quobyte [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=85585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG oslo_concurrency.processutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=85585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:35 devstack sudo[85701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:32:35 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:32:35 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG oslo_concurrency.processutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.271s {{(pid=85585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG cinder.manager [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Notifying Schedulers of capabilities ... {{(pid=85585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:32:35 devstack cinder-volume[85585]: INFO cinder.volume.manager [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Driver initialization completed successfully. Sep 21 16:32:35 devstack cinder-volume[85585]: INFO cinder.manager [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Initiating service 3 cleanup Sep 21 16:32:35 devstack cinder-volume[85585]: INFO cinder.manager [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Service 3 cleanup completed. Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG cinder.service [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Creating RPC server for service cinder-volume {{(pid=85585) start /opt/stack/cinder/cinder/service.py:231}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG cinder.service [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85585) start /opt/stack/cinder/cinder/service.py:237}} Sep 21 16:32:35 devstack cinder-volume[85585]: INFO cinder.volume.manager [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG cinder.volume.drivers.quobyte [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=85585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG cinder.volume.drivers.quobyte [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=85585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG oslo_concurrency.processutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=85585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:35 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:32:35 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:32:35 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Sep 21 16:32:35 devstack cinder-volume[85585]: DEBUG oslo_concurrency.processutils [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.362s {{(pid=85585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:36 devstack cinder-volume[85585]: INFO cinder.volume.manager [None req-bbb64a1e-ce6c-44e5-a163-00d78d643250 None None] Driver post RPC initialization completed successfully. Sep 21 16:32:39 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-3137f08d-abd2-45e9-ab0f-03643eeec29f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:32:39 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-3137f08d-abd2-45e9-ab0f-03643eeec29f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:32:39 devstack cinder-volume[85585]: DEBUG cinder.volume.drivers.quobyte [None req-3137f08d-abd2-45e9-ab0f-03643eeec29f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=85585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:32:39 devstack cinder-volume[85585]: DEBUG cinder.volume.drivers.quobyte [None req-3137f08d-abd2-45e9-ab0f-03643eeec29f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=85585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:32:39 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-3137f08d-abd2-45e9-ab0f-03643eeec29f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:32:39 devstack cinder-volume[85585]: DEBUG oslo_concurrency.processutils [None req-3137f08d-abd2-45e9-ab0f-03643eeec29f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=85585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:39 devstack sudo[85881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:32:39 devstack sudo[85881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:32:39 devstack cinder-volume[85373]: INFO oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Caught SIGTERM, stopping children Sep 21 16:32:39 devstack cinder-volume[85373]: DEBUG oslo_concurrency.lockutils [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Acquiring lock "singleton_lock" {{(pid=85373) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 16:32:39 devstack cinder-volume[85373]: DEBUG oslo_concurrency.lockutils [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Acquired lock "singleton_lock" {{(pid=85373) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 16:32:39 devstack cinder-volume[85373]: DEBUG oslo_concurrency.lockutils [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Releasing lock "singleton_lock" {{(pid=85373) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 16:32:39 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Stop services. {{(pid=85373) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 21 16:32:39 devstack cinder-volume[85373]: DEBUG oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Killing children. {{(pid=85373) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 21 16:32:39 devstack cinder-volume[85373]: INFO oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Waiting on 1 children to exit Sep 21 16:32:39 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Acquiring lock "singleton_lock" {{(pid=85585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 16:32:39 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Acquired lock "singleton_lock" {{(pid=85585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 16:32:39 devstack cinder-volume[85585]: DEBUG oslo_concurrency.lockutils [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Releasing lock "singleton_lock" {{(pid=85585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 16:32:39 devstack sudo[85881]: pam_unix(sudo:session): session closed for user root Sep 21 16:32:39 devstack cinder-volume[85585]: DEBUG oslo_concurrency.processutils [None req-3137f08d-abd2-45e9-ab0f-03643eeec29f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.293s {{(pid=85585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:39 devstack cinder-volume[85585]: DEBUG cinder.manager [None req-3137f08d-abd2-45e9-ab0f-03643eeec29f None None] Notifying Schedulers of capabilities ... {{(pid=85585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3137f08d-abd2-45e9-ab0f-03643eeec29f None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3137f08d-abd2-45e9-ab0f-03643eeec29f None None] Unable to connect to AMQP server on 192.168.122.69:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server [None req-3137f08d-abd2-45e9-ab0f-03643eeec29f None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.69:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server method() Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server return _publish( Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server listener(*args) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.69:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 21 16:32:39 devstack cinder-volume[85585]: ERROR oslo_messaging.rpc.server Sep 21 16:32:39 devstack cinder-volume[85585]: WARNING amqp [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 21 16:32:39 devstack cinder-volume[85585]: WARNING amqp [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 21 16:32:39 devstack cinder-volume[85373]: INFO oslo_service.backend._eventlet.service [None req-e4958662-0a66-48bd-8e1a-5c3104cd2044 None None] Child 85585 exited with status 0 Sep 21 16:32:40 devstack cinder-volume[85888]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 21 16:32:40 devstack cinder-volume[85888]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 21 16:32:40 devstack cinder-volume[85888]: we strongly recommend against using it for new projects. Sep 21 16:32:40 devstack cinder-volume[85888]: If you are already using Eventlet, we recommend migrating to a different Sep 21 16:32:40 devstack cinder-volume[85888]: framework. For more detail see Sep 21 16:32:40 devstack cinder-volume[85888]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 21 16:32:40 devstack cinder-volume[85888]: import eventlet # noqa Sep 21 16:32:42 devstack cinder-volume[85888]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85888) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 16:32:42 devstack cinder-volume[85888]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85888) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 16:32:42 devstack cinder-volume[85888]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85888) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 16:32:43 devstack cinder-volume[85888]: INFO dbcounter [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] Registered counter for database cinder Sep 21 16:32:43 devstack cinder-volume[85888]: DEBUG oslo_db.sqlalchemy.engines [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85888) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 16:32:43 devstack cinder-volume[85888]: DEBUG dbcounter [-] [85888] Writer thread running {{(pid=85888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 21 16:32:43 devstack cinder-volume[85888]: INFO cinder.rpc [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 21 16:32:43 devstack cinder-volume[85888]: INFO cinder.rpc [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 21 16:32:43 devstack cinder-volume[85888]: DEBUG oslo_db.sqlalchemy.engines [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85888) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 16:32:44 devstack cinder-volume[85888]: INFO cinder.volume.manager [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] Determined volume DB was empty at startup. Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG cinder.volume.manager [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85888) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 21 16:32:44 devstack cinder-volume[85888]: WARNING stevedore.named [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 21 16:32:44 devstack cinder-volume[85888]: WARNING castellan.key_manager [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 16:32:44 devstack cinder-volume[85888]: WARNING cinder.keymgr.conf_key_mgr [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 16:32:44 devstack cinder-volume[85888]: INFO cinder.volume.manager [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_db.sqlalchemy.engines [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85888) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 16:32:44 devstack cinder-volume[85888]: INFO oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] Starting 1 workers Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] Started child 86030 {{(pid=85888) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] Full set of CONF: {{(pid=85888) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] ******************************************************************************** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] Configuration options gathered from: {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] ================================================================================ {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] allow_availability_zone_fallback = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] allow_compression_on_image_upload = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] allowed_direct_url_schemes = [] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] api_rate_limit = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] auth_strategy = keystone {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_availability_zone = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_host = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[86030]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_name = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_stats_polling_interval = 60 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backup_api_class = cinder.backup.api.API {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backup_name_template = backup-%s {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backup_use_same_host = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backup_use_temp_snapshot = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] chap_password = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] chap_username = {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cinder_internal_tenant_project_id = 6b35e2ee546b473f9dc269950d842bfd {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cinder_internal_tenant_user_id = 45eee186905c4e119034e610a5d124cd {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cluster = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] compression_format = gzip {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] compute_api_class = cinder.compute.nova.API {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] config_dir = [] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] config_source = [] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] control_exchange = openstack {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] debug = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] default_availability_zone = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] default_group_type = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] default_volume_type = QuobyteHD {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] disk_geometry = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] driver_client_cert = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] driver_client_cert_key = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] driver_data_namespace = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] driver_ssl_cert_path = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] driver_ssl_cert_verify = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] driver_use_ssl = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] enable_new_services = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] enable_unsupported_driver = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] enabled_backends = ['QuobyteHD'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] enforce_multipath_for_image_xfer = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] filter_function = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance_api_insecure = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance_api_servers = ['http://192.168.122.69/image'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance_api_ssl_compression = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance_ca_certificates_file = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance_catalog_info = image:glance:publicURL {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance_certfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance_keyfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance_num_retries = 3 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance_request_timeout = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] goodness_function = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] graceful_shutdown_timeout = 5 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] group_api_class = cinder.group.api.API {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] host = devstack {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] image_compress_on_upload = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] image_conversion_address_space_limit = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] image_conversion_cpu_limit = 60 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] image_conversion_disable = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] image_introspection_address_space_limit = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] image_introspection_cpu_limit = 60 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] image_upload_use_cinder_backend = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] image_upload_use_internal_tenant = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] image_volume_cache_enabled = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] image_volume_cache_max_count = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] image_volume_cache_max_size_gb = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] init_host_max_objects_retrieval = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] instance_format = [instance: %(uuid)s] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] iscsi_target_flags = {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] iscsi_write_cache = on {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] iser_helper = tgtadm {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] iser_ip_address = 192.168.122.69 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] iser_port = 3260 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] log_color = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] log_config_append = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] log_dir = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] log_file = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] log_options = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] log_rotate_interval = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] log_rotate_interval_type = days {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] log_rotation_type = none {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] max_age = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] max_logfile_count = 30 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] max_logfile_size_mb = 200 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] max_over_subscription_ratio = 20.0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] message_reap_interval = 86400 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 21 16:32:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86030) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] message_ttl = 2592000 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] migration_create_volume_timeout_secs = 300 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] monkey_patch = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] monkey_patch_modules = [] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] my_ip = 192.168.122.69 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] no_snapshot_gb_quota = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] num_iser_scan_tries = 3 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] num_shell_tries = 3 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] num_volume_device_scan_tries = 3 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] nvmeof_conn_info_version = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] nvmet_ns_id = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] nvmet_port_id = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] osapi_max_limit = 1000 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] osapi_volume_ext_list = [] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] osapi_volume_listen = 0.0.0.0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] osapi_volume_listen_port = 8776 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] osapi_volume_use_ssl = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] osapi_volume_workers = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] per_volume_size_limit = -1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] periodic_fuzzy_delay = 60 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] periodic_interval = 60 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] project_id_regex = [0-9a-f\-]+ {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] public_endpoint = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] publish_errors = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] quota_backup_gigabytes = 1000 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] quota_backups = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] quota_gigabytes = 1000 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] quota_groups = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] quota_snapshots = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] quota_volumes = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] rate_limit_burst = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] rate_limit_except_level = CRITICAL {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] rate_limit_interval = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] reinit_driver_count = 3 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] replication_device = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] report_discard_supported = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] report_interval = 120 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] reservation_clean_interval = 86400 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] reservation_expire = 86400 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] reserved_image_namespaces = [] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] reserved_percentage = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] rpc_response_timeout = 120 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] run_external_periodic_tasks = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] scst_target_driver = iscsi {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] scst_target_iqn_name = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] service_down_time = 720 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] shell_completion = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] snapshot_name_template = snapshot-%s {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] split_loggers = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] state_path = /opt/stack/data/cinder {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] storage_availability_zone = nova {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] storage_protocol = iSCSI {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] syslog_log_facility = LOG_USER {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] target_helper = lioadm {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] target_ip_address = 192.168.122.69 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] target_port = 3260 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] target_protocol = iscsi {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] target_secondary_ip_addresses = [] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] trace_flags = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] transfer_api_class = cinder.transfer.api.API {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] transport_url = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] until_refresh = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] use_chap_auth = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] use_default_quota_class = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] use_journal = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] use_json = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] use_multipath_for_image_xfer = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] use_stderr = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] use_syslog = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] verify_glance_signatures = enabled {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] volume_api_class = cinder.volume.api.API {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] volume_backend_name = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] volume_clear = zero {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] volume_clear_ionice = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] volume_clear_size = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] volume_copy_bps_limit = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] volume_dd_blocksize = 1M {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] volume_name_template = volume-%s {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] volume_service_inithost_offload = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] volume_usage_audit_period = month {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] zoning_mode = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_concurrency.disable_process_locking = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.auth_section = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.auth_type = password {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.auth_version = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.cache = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.certfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.delay_auth_decision = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.http_connect_timeout = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.include_service_catalog = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.insecure = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.interface = public {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.keyfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_password = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcache_username = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.region_name = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.service_token_roles_required = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.service_type = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.token_cache_time = 300 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.69/identity {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.backend = dogpile.cache.null {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.backend_argument = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.backend_expiration_time = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.config_prefix = cache.oslo {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.debug_cache_backend = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86030) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.enable_retry_client = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.enable_socket_keepalive = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.enabled = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.quobyte [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 21 16:32:44 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.quobyte [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.expiration_time = 600 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.hashclient_retry_attempts = 2 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Running cmd (subprocess): mount.quobyte {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.memcache_dead_retry = 300 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.memcache_pool_maxsize = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.memcache_sasl_enabled = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.password = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.proxies = [] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.redis_db = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.redis_sentinel_service_name = mymaster {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.redis_server = localhost:6379 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.retry_attempts = 2 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.retry_delay = 0.0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.socket_keepalive_count = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.socket_keepalive_idle = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.socket_keepalive_interval = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.socket_timeout = 1.0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.tls_allowed_ciphers = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.tls_cafile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.tls_certfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.tls_enabled = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.tls_keyfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cache.username = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] coordination.backend_url = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.asyncio_connection = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.asyncio_slave_connection = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.backend = sqlalchemy {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.connection = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.connection_debug = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.connection_parameters = {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.connection_recycle_time = 3600 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.connection_trace = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.db_inc_retry_interval = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.db_max_retries = 20 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.db_max_retry_interval = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.db_retry_interval = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.max_overflow = 50 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.max_pool_size = 5 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.max_retries = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.mysql_wsrep_sync_wait = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.pool_timeout = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.retry_interval = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.slave_connection = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.sqlite_synchronous = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.synchronous_reader = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] database.use_db_reconnect = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_tracing.insecure = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler.connection_string = messaging:// {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler.enabled = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler.es_doc_type = notification {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler.es_scroll_size = 10000 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler.es_scroll_time = 2m {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler.filter_error_trace = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler.hmac_keys = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler.sentinel_service_name = mymaster {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler.socket_timeout = 0.1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler.trace_requests = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler.trace_sqlalchemy = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler_jaeger.process_tags = {} {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler_jaeger.service_name_prefix = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] profiler_otlp.service_name_prefix = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_policy.enforce_new_defaults = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_policy.policy_default_rule = default {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_policy.policy_file = policy.yaml {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_policy.remote_timeout = 60.0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] privsep_osbrick.group = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] privsep_osbrick.helper_command = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] privsep_osbrick.user = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cinder_sys_admin.group = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cinder_sys_admin.helper_command = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] CMD "mount.quobyte" returned: 1 in 0.113s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:32:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:32:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] cinder_sys_admin.user = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] service_user.auth_section = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] service_user.auth_type = password {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] service_user.cafile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] service_user.certfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] service_user.collect_timing = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] service_user.insecure = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] service_user.keyfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] service_user.send_service_user_token = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:32:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] service_user.split_loggers = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] service_user.timeout = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] service_user.tls_ciphers = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] service_user.tls_min_version = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance.auth_section = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance.auth_type = password {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance.certfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance.collect_timing = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance.insecure = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance.keyfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance.region_name = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance.split_loggers = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance.timeout = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance.tls_ciphers = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] glance.tls_min_version = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.backend_availability_zone = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.chap_password = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.chap_username = {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.disk_geometry = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.driver_client_cert = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.driver_client_cert_key = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.driver_data_namespace = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.driver_use_ssl = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.enable_unsupported_driver = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack sudo[86045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:32:44 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.extra_capabilities = {} {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.filter_function = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.goodness_function = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.iscsi_target_flags = {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.iscsi_write_cache = on {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.iser_helper = tgtadm {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.iser_ip_address = 192.168.122.69 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.iser_port = 3260 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.nas_host = {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.nas_login = admin {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.nas_mount_options = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.nas_password = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.nas_private_key = {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.nas_share_path = {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.nas_ssh_port = 22 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.num_shell_tries = 3 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.nvmet_port_id = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.quobyte_client_cfg = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.quobyte_volume_url = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.replication_device = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.report_discard_supported = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.reserved_percentage = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.scst_target_driver = iscsi {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.scst_target_iqn_name = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.storage_protocol = iSCSI {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.target_helper = tgtadm {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.target_ip_address = 192.168.122.69 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.target_port = 3260 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.target_protocol = iscsi {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.trace_flags = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.unique_fqdn_network = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.use_chap_auth = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.volume_backend_name = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.volume_clear = zero {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.volume_clear_ionice = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.volume_clear_size = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_reports.file_event_handler = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_reports.log_dir = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.backend_availability_zone = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.backend_host = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.chap_password = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.chap_username = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.chiscsi_conf = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.disk_geometry = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.driver_client_cert = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.driver_client_cert_key = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.driver_data_namespace = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.driver_use_ssl = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.extra_capabilities = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.filter_function = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.goodness_function = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.iscsi_target_flags = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.iscsi_write_cache = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.iser_helper = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.iser_ip_address = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.iser_port = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.iser_target_prefix = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.nas_host = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.nas_login = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.nas_mount_options = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.nas_password = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.nas_private_key = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.nas_share_path = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.nas_ssh_port = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.num_shell_tries = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.nvmet_ns_id = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.nvmet_port_id = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.replication_device = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.report_discard_supported = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:44 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.reserved_percentage = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.scst_target_driver = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.storage_protocol = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.target_helper = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.target_ip_address = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.target_port = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.target_prefix = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.target_protocol = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.trace_flags = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.unique_fqdn_network = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.use_chap_auth = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.volume_clear = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.volume_clear_ionice = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.volume_clear_size = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] QuobyteHD.volumes_dir = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.ssl = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.ssl_version = {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_notifications.driver = [] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_notifications.retry = -1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] oslo_messaging_notifications.transport_url = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] key_manager.fixed_key = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.barbican_api_version = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.barbican_endpoint = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.barbican_endpoint_type = public {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.barbican_region_name = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.cafile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.certfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.collect_timing = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.insecure = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.keyfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.number_of_retries = 60 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.retry_delay = 1 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.send_service_user_token = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.split_loggers = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.timeout = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.tls_ciphers = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.tls_min_version = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.verify_ssl = True {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican.verify_ssl_path = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican_service_user.auth_section = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican_service_user.auth_type = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican_service_user.cafile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican_service_user.certfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican_service_user.collect_timing = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican_service_user.insecure = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican_service_user.keyfile = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican_service_user.split_loggers = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican_service_user.timeout = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican_service_user.tls_ciphers = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] barbican_service_user.tls_min_version = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.approle_role_id = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.approle_secret_id = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.auth_method = approle {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.auth_path = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.kv_mountpoint = secret {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.kv_path = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.kv_version = 2 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.namespace = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.root_token_id = **** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.ssl_ca_crt_file = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.timeout = 60.0 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.token_file = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.token_role = None {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.use_ssl = False {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 16:32:45 devstack cinder-volume[85888]: DEBUG oslo_service.backend._eventlet.service [None req-7f6c02ad-9934-4409-b8df-ca3b3fa4351c None None] ******************************************************************************** {{(pid=85888) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 21 16:32:45 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.456s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:45 devstack cinder-volume[86030]: INFO cinder.volume.driver [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Driver hasn't implemented _init_vendor_properties() Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG cinder.volume.driver [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6392135620117, 'free_capacity_gb': 1775.6392135620117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86030) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG oslo_db.sqlalchemy.engines [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86030) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writer thread running {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG cinder.db.api [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Building query based on filter {{(pid=86030) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86030) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:45 devstack cinder-volume[86030]: INFO cinder.keymgr.migration [None req-4ae6f001-173f-416e-8259-55390ede630a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 21 16:32:45 devstack sudo[86139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:32:45 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:32:45 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.312s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:32:45 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Driver initialization completed successfully. Sep 21 16:32:45 devstack cinder-volume[86030]: INFO cinder.manager [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Initiating service 3 cleanup Sep 21 16:32:45 devstack cinder-volume[86030]: INFO cinder.manager [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Service 3 cleanup completed. Sep 21 16:32:45 devstack cinder-volume[86030]: DEBUG cinder.service [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Creating RPC server for service cinder-volume {{(pid=86030) start /opt/stack/cinder/cinder/service.py:231}} Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG cinder.service [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86030) start /opt/stack/cinder/cinder/service.py:237}} Sep 21 16:32:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:46 devstack sudo[86172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:32:46 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-76770e64-669a-4d0a-8d9f-8f4e3c781b14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-76770e64-669a-4d0a-8d9f-8f4e3c781b14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-76770e64-669a-4d0a-8d9f-8f4e3c781b14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-76770e64-669a-4d0a-8d9f-8f4e3c781b14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-76770e64-669a-4d0a-8d9f-8f4e3c781b14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-76770e64-669a-4d0a-8d9f-8f4e3c781b14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:32:46 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:32:46 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:32:46 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.501s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fcca10a0-2f38-434d-b6b6-ba4dfbe1daf1 None None] Driver post RPC initialization completed successfully. Sep 21 16:32:46 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-76770e64-669a-4d0a-8d9f-8f4e3c781b14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.289s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:32:46 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-76770e64-669a-4d0a-8d9f-8f4e3c781b14 None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:32:54 devstack cinder-volume[85888]: DEBUG dbcounter [-] [85888] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85888) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:32:56 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=3 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:32:56 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:33:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:33:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 6 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:33:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:34:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:34:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:34:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:34:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:34:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:34:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:34:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:34:07 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:34:07 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:08 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.603s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:34:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:34:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:34:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 6 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:34:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Flow 'volume_create_manager' (c6db2fad-6086-495c-a14b-117e77fad388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3f0daf-85ec-44ca-83eb-0a06a453a52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3f0daf-85ec-44ca-83eb-0a06a453a52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-315449586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ac157e-e395-4615-802b-9e09437ac94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52384e470cfb412f962129f7594cc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:34:15Z,use_quota=True,user_id='e3b1169a9c51464e92d07b7b1962c900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e70bb33-f43d-4ad0-b3dc-1b044a31b6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e70bb33-f43d-4ad0-b3dc-1b044a31b6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60fa923e-c7ae-458a-81cc-422378d60324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60fa923e-c7ae-458a-81cc-422378d60324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ac157e-e395-4615-802b-9e09437ac94e', 'volume_name': 'volume-b1ac157e-e395-4615-802b-9e09437ac94e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf890f3-bf29-41b5-9e1f-99433a28079c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf890f3-bf29-41b5-9e1f-99433a28079c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993de07f-b46e-40c5-9ea7-8c65b5d6f139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:15 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Volume b1ac157e-e395-4615-802b-9e09437ac94e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ac157e-e395-4615-802b-9e09437ac94e', 'volume_size': 1} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-315449586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ac157e-e395-4615-802b-9e09437ac94e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52384e470cfb412f962129f7594cc8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:34:15Z,use_quota=True,user_id='e3b1169a9c51464e92d07b7b1962c900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Creating volume b1ac157e-e395-4615-802b-9e09437ac94e {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:34:15 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:34:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b1ac157e-e395-4615-802b-9e09437ac94e 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:34:15 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b1ac157e-e395-4615-802b-9e09437ac94e 1073741824 Sep 21 16:34:15 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Flow 'volume_create_manager' (88e71494-2e09-4820-b758-ad88cd5a15a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd91701-5b57-47f8-b02b-aab45ec8519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:16 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd91701-5b57-47f8-b02b-aab45ec8519f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-221992146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2039662-3400-49e1-86c7-d1b90aa15ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adaa895395643ef817fc51529b5adf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:34:17Z,use_quota=True,user_id='fe306820db5647c6b8d13c027bc53952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a749928-0127-4480-8096-f8ba636588ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a749928-0127-4480-8096-f8ba636588ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9bead2-f992-4e0e-802e-0d0e9e878618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9bead2-f992-4e0e-802e-0d0e9e878618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2039662-3400-49e1-86c7-d1b90aa15ff5', 'volume_name': 'volume-b2039662-3400-49e1-86c7-d1b90aa15ff5', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4824a1-1444-46a4-b3df-15fa3d4d2a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4824a1-1444-46a4-b3df-15fa3d4d2a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89243375-85dc-4643-8c44-0dfb1d796695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:16 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Volume b2039662-3400-49e1-86c7-d1b90aa15ff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2039662-3400-49e1-86c7-d1b90aa15ff5', 'volume_size': 1} Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b1ac157e-e395-4615-802b-9e09437ac94e 1073741824" returned: 0 in 1.217s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:34:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b1ac157e-e395-4615-802b-9e09437ac94e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:34:17 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b1ac157e-e395-4615-802b-9e09437ac94e Sep 21 16:34:17 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:17 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b1ac157e-e395-4615-802b-9e09437ac94e" returned: 0 in 0.576s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-221992146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2039662-3400-49e1-86c7-d1b90aa15ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adaa895395643ef817fc51529b5adf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:34:17Z,use_quota=True,user_id='fe306820db5647c6b8d13c027bc53952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Creating volume b2039662-3400-49e1-86c7-d1b90aa15ff5 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:34:17 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2039662-3400-49e1-86c7-d1b90aa15ff5 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993de07f-b46e-40c5-9ea7-8c65b5d6f139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ac157e-e395-4615-802b-9e09437ac94e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc1f6c2-1b9c-45fb-8c3b-11d716361d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:17 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2039662-3400-49e1-86c7-d1b90aa15ff5 1073741824 Sep 21 16:34:17 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:17 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Volume volume-b1ac157e-e395-4615-802b-9e09437ac94e (b1ac157e-e395-4615-802b-9e09437ac94e): created successfully Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc1f6c2-1b9c-45fb-8c3b-11d716361d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Flow 'volume_create_manager' (c6db2fad-6086-495c-a14b-117e77fad388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:34:17 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-25c5975f-4ae2-41e8-8c42-063108f01566 tempest-ServerRescueNegativeTestJSON-555796074 None] Created volume successfully. Sep 21 16:34:18 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2039662-3400-49e1-86c7-d1b90aa15ff5 1073741824" returned: 0 in 0.995s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:34:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2039662-3400-49e1-86c7-d1b90aa15ff5 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:34:18 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2039662-3400-49e1-86c7-d1b90aa15ff5 Sep 21 16:34:18 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:19 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2039662-3400-49e1-86c7-d1b90aa15ff5" returned: 0 in 0.773s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:34:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:34:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:34:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89243375-85dc-4643-8c44-0dfb1d796695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2039662-3400-49e1-86c7-d1b90aa15ff5', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468f5027-9d89-4a90-890c-5885c2d23b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:19 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Volume volume-b2039662-3400-49e1-86c7-d1b90aa15ff5 (b2039662-3400-49e1-86c7-d1b90aa15ff5): created successfully Sep 21 16:34:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468f5027-9d89-4a90-890c-5885c2d23b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Flow 'volume_create_manager' (88e71494-2e09-4820-b758-ad88cd5a15a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:34:19 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-564004de-19be-4f21-9dd4-922e1c84a11a tempest-VolumesAdminNegativeTest-592494629 None] Created volume successfully. Sep 21 16:34:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Acquiring lock "cinder-b2039662-3400-49e1-86c7-d1b90aa15ff5-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:34:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Lock "cinder-b2039662-3400-49e1-86c7-d1b90aa15ff5-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:34:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Acquiring lock "cinder-quobyte-b2039662-3400-49e1-86c7-d1b90aa15ff5" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:34:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Lock "cinder-quobyte-b2039662-3400-49e1-86c7-d1b90aa15ff5" acquired by "delete_volume" :: waited 0.038s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:34:21 devstack cinder-volume[86030]: INFO oslo.privsep.daemon [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpf9vtbaif/privsep.sock'] Sep 21 16:34:21 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpf9vtbaif/privsep.sock Sep 21 16:34:21 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:23 devstack cinder-volume[86030]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 21 16:34:23 devstack cinder-volume[86030]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 21 16:34:23 devstack cinder-volume[86030]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 21 16:34:23 devstack cinder-volume[86030]: WARNING oslo.privsep.daemon [-] privsep log: Sep 21 16:34:23 devstack cinder-volume[86030]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 21 16:34:23 devstack cinder-volume[86030]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 21 16:34:23 devstack cinder-volume[86030]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 21 16:34:23 devstack cinder-volume[86030]: WARNING oslo.privsep.daemon [-] privsep log: Sep 21 16:34:23 devstack cinder-volume[86030]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 21 16:34:23 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:23 devstack cinder-volume[86030]: INFO oslo.privsep.daemon [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Spawned new privsep daemon via rootwrap Sep 21 16:34:23 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Accepted privsep connection to /tmp/tmpf9vtbaif/privsep.sock {{(pid=86030) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 21 16:34:23 devstack cinder-volume[86030]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 21 16:34:23 devstack cinder-volume[86030]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 21 16:34:23 devstack cinder-volume[86030]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 21 16:34:23 devstack cinder-volume[86030]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87545 Sep 21 16:34:23 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfde511-c6ca-4459-bb6b-eef21df15bd7]: (2,) {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:34:23 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa81ac2-21eb-450c-8f6a-0248b2d7e31a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:34:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2039662-3400-49e1-86c7-d1b90aa15ff5 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:34:24 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2039662-3400-49e1-86c7-d1b90aa15ff5 Sep 21 16:34:24 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:24 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2039662-3400-49e1-86c7-d1b90aa15ff5" returned: 0 in 0.613s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:34:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2039662-3400-49e1-86c7-d1b90aa15ff5 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:34:24 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2039662-3400-49e1-86c7-d1b90aa15ff5 Sep 21 16:34:24 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:25 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2039662-3400-49e1-86c7-d1b90aa15ff5" returned: 0 in 0.487s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:34:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Lock "cinder-quobyte-b2039662-3400-49e1-86c7-d1b90aa15ff5" released by "delete_volume" :: held 3.712s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:34:25 devstack cinder-volume[86030]: WARNING cinder.quota [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:34:25 devstack cinder-volume[86030]: WARNING cinder.quota [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:34:25 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Created reservations ['b24c8e25-8ac0-4595-8ad0-ddc1a3ef4409', 'daf629e1-cf89-4c52-8e7e-0c6a5b30478c', 'b41b601f-f668-4569-8318-c11db2859336', 'c327e095-b85b-4375-b2a6-553e6f0307f3'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:34:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:34:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:34:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:34:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:34:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:34:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:34:25 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:34:25 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:26 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.702s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:34:26 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:34:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Deleted volume successfully. Sep 21 16:34:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-16ef124d-4b72-4864-88a8-f40f788f7f2a tempest-VolumesAdminNegativeTest-592494629 None] Lock "cinder-b2039662-3400-49e1-86c7-d1b90aa15ff5-delete_volume" released by "delete_volume" :: held 5.398s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:34:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Acquiring lock "cinder-b1ac157e-e395-4615-802b-9e09437ac94e-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:34:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Lock "cinder-b1ac157e-e395-4615-802b-9e09437ac94e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:34:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Acquiring lock "cinder-quobyte-b1ac157e-e395-4615-802b-9e09437ac94e" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:34:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Lock "cinder-quobyte-b1ac157e-e395-4615-802b-9e09437ac94e" acquired by "delete_volume" :: waited 0.035s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:34:33 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[da88f7c1-522d-4308-8d91-02b81e3fae63]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:34:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b1ac157e-e395-4615-802b-9e09437ac94e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:34:34 devstack sudo[87670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b1ac157e-e395-4615-802b-9e09437ac94e Sep 21 16:34:34 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:34 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b1ac157e-e395-4615-802b-9e09437ac94e" returned: 0 in 0.706s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:34:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b1ac157e-e395-4615-802b-9e09437ac94e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:34:34 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b1ac157e-e395-4615-802b-9e09437ac94e Sep 21 16:34:34 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:35 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b1ac157e-e395-4615-802b-9e09437ac94e" returned: 0 in 0.539s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:34:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Lock "cinder-quobyte-b1ac157e-e395-4615-802b-9e09437ac94e" released by "delete_volume" :: held 1.363s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:34:35 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Created reservations ['14fc0a03-c944-4107-9fca-c2af4ea85e07', 'd68e90c3-1d2d-48ff-8c8e-50c2165aeacf', 'e258ba80-0ed4-4831-8e3e-e4dcc642e4f3', '0ad64488-edc9-476e-acf7-bf1fdf9718a1'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:34:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:34:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:34:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:34:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:34:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:34:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:34:35 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:34:35 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:35 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.417s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:34:35 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:34:35 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Deleted volume successfully. Sep 21 16:34:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8bd9f118-615b-47b5-8231-7d2ce7137820 tempest-ServerRescueNegativeTestJSON-555796074 None] Lock "cinder-b1ac157e-e395-4615-802b-9e09437ac94e-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:34:45 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=15,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:34:45 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=13,cinder:INSERT=8,cinder:UPDATE=23,cinder:DELETE=3 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Flow 'volume_create_manager' (60c6f7c0-e5dd-4401-b4d7-38fa42072057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d1dbb4-0d3f-448a-87d9-e23cb24068b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d1dbb4-0d3f-448a-87d9-e23cb24068b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1168154948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64acdf9e-d8ac-44d4-9b2d-ba40f6135611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8f06c8aa844c4992b59d9805758a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:34:47Z,use_quota=True,user_id='0f266d762fed491f8ca8d1a6234d48a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92c89fb-4083-467c-a61d-2e89ee413888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92c89fb-4083-467c-a61d-2e89ee413888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3525175-f870-4caf-a5c6-96162b195ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3525175-f870-4caf-a5c6-96162b195ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64acdf9e-d8ac-44d4-9b2d-ba40f6135611', 'volume_name': 'volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ff9aaa-4fc2-414a-bf2f-ef6fd3f2c66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ff9aaa-4fc2-414a-bf2f-ef6fd3f2c66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686f2c4b-1c13-44bc-8fb2-0f1fe2c7f038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:47 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Volume 64acdf9e-d8ac-44d4-9b2d-ba40f6135611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611', 'volume_size': 1} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1168154948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64acdf9e-d8ac-44d4-9b2d-ba40f6135611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8f06c8aa844c4992b59d9805758a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:34:47Z,use_quota=True,user_id='0f266d762fed491f8ca8d1a6234d48a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Creating volume 64acdf9e-d8ac-44d4-9b2d-ba40f6135611 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:34:47 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:34:47 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611 1073741824 Sep 21 16:34:47 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:47 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611 1073741824" returned: 0 in 0.539s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:34:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:34:47 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611 Sep 21 16:34:47 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:34:48 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Sep 21 16:34:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611" returned: 0 in 0.285s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:34:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:34:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:34:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686f2c4b-1c13-44bc-8fb2-0f1fe2c7f038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fc334e-8a99-40bb-9c8f-369ebce022f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:34:48 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Volume volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611 (64acdf9e-d8ac-44d4-9b2d-ba40f6135611): created successfully Sep 21 16:34:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fc334e-8a99-40bb-9c8f-369ebce022f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:34:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Flow 'volume_create_manager' (60c6f7c0-e5dd-4401-b4d7-38fa42072057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:34:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a6df190b-fb3b-4405-aa37-9a857e008c2e tempest-AttachVolumeTestJSON-1403093250 None] Created volume successfully. Sep 21 16:34:52 devstack cinder-volume[86030]: WARNING py.warnings [req-8f9e0b77-ad68-47ea-a9d7-180ef5416dde req-a69d1828-fc3c-41cd-ba6d-0518238707c7 tempest-AttachVolumeTestJSON-1403093250 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 21 16:34:52 devstack cinder-volume[86030]: .first() Sep 21 16:34:52 devstack cinder-volume[86030]: Sep 21 16:34:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-8f9e0b77-ad68-47ea-a9d7-180ef5416dde req-a69d1828-fc3c-41cd-ba6d-0518238707c7 tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:34:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-8f9e0b77-ad68-47ea-a9d7-180ef5416dde req-a69d1828-fc3c-41cd-ba6d-0518238707c7 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:34:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-8f9e0b77-ad68-47ea-a9d7-180ef5416dde req-a69d1828-fc3c-41cd-ba6d-0518238707c7 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:34:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-8f9e0b77-ad68-47ea-a9d7-180ef5416dde req-a69d1828-fc3c-41cd-ba6d-0518238707c7 tempest-AttachVolumeTestJSON-1403093250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40110027-d535-419d-a575-ec7a4cff6b34', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:34:52 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-8f9e0b77-ad68-47ea-a9d7-180ef5416dde req-a69d1828-fc3c-41cd-ba6d-0518238707c7 tempest-AttachVolumeTestJSON-1403093250 None] attachment_update completed successfully. Sep 21 16:35:02 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:35:02 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:35:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:35:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:35:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:35:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:35:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:35:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:35:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:35:07 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:35:07 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:35:08 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Sep 21 16:35:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.543s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:35:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:35:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:35:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 8 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:35:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Flow 'volume_create_manager' (7060cd21-ef38-4683-80ec-af0134039643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c938b78-3018-42b9-8f8d-f5673a6870cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c938b78-3018-42b9-8f8d-f5673a6870cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1750180446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa733132-5826-4373-a800-c98113912a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a8071aa5b6410ab1b58e4930ec6d04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:35:11Z,use_quota=True,user_id='fd0518a9224243c4ab3d2062b53175a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52e5453-451e-421c-a3e8-2585be891bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52e5453-451e-421c-a3e8-2585be891bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc94b25-bb2d-4d7f-a2f3-0286cec95e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc94b25-bb2d-4d7f-a2f3-0286cec95e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa733132-5826-4373-a800-c98113912a12', 'volume_name': 'volume-fa733132-5826-4373-a800-c98113912a12', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32798a3-ac24-4ac2-bbc1-3eafc8394a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32798a3-ac24-4ac2-bbc1-3eafc8394a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a4b403-36fe-479e-b007-151ed44bfdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:11 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Volume fa733132-5826-4373-a800-c98113912a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa733132-5826-4373-a800-c98113912a12', 'volume_size': 1} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1750180446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa733132-5826-4373-a800-c98113912a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54a8071aa5b6410ab1b58e4930ec6d04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:35:11Z,use_quota=True,user_id='fd0518a9224243c4ab3d2062b53175a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Creating volume fa733132-5826-4373-a800-c98113912a12 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:35:11 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:35:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa733132-5826-4373-a800-c98113912a12 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:35:11 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa733132-5826-4373-a800-c98113912a12 1073741824 Sep 21 16:35:11 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:35:12 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Sep 21 16:35:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa733132-5826-4373-a800-c98113912a12 1073741824" returned: 0 in 1.000s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:35:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa733132-5826-4373-a800-c98113912a12 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:35:12 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa733132-5826-4373-a800-c98113912a12 Sep 21 16:35:12 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:35:13 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Sep 21 16:35:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa733132-5826-4373-a800-c98113912a12" returned: 0 in 0.364s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:35:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:35:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:35:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a4b403-36fe-479e-b007-151ed44bfdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa733132-5826-4373-a800-c98113912a12', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96c14c4-9804-4674-a131-2ec15d2abfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:13 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Volume volume-fa733132-5826-4373-a800-c98113912a12 (fa733132-5826-4373-a800-c98113912a12): created successfully Sep 21 16:35:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96c14c4-9804-4674-a131-2ec15d2abfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Flow 'volume_create_manager' (7060cd21-ef38-4683-80ec-af0134039643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:35:13 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-47b1c9fe-395c-443c-96dd-1fc56f149850 tempest-DeleteServersTestJSON-50214159 None] Created volume successfully. Sep 21 16:35:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-b085a5aa-6645-4a4b-a396-342fbd3f151e req-accacbb8-1a0f-4de4-b7eb-977cd4a5c1df tempest-DeleteServersTestJSON-50214159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:35:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-b085a5aa-6645-4a4b-a396-342fbd3f151e req-accacbb8-1a0f-4de4-b7eb-977cd4a5c1df tempest-DeleteServersTestJSON-50214159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:35:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-b085a5aa-6645-4a4b-a396-342fbd3f151e req-accacbb8-1a0f-4de4-b7eb-977cd4a5c1df tempest-DeleteServersTestJSON-50214159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:35:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-b085a5aa-6645-4a4b-a396-342fbd3f151e req-accacbb8-1a0f-4de4-b7eb-977cd4a5c1df tempest-DeleteServersTestJSON-50214159 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-fa733132-5826-4373-a800-c98113912a12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '411464ee-25df-4015-9725-6fb6a6920447', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:35:16 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-b085a5aa-6645-4a4b-a396-342fbd3f151e req-accacbb8-1a0f-4de4-b7eb-977cd4a5c1df tempest-DeleteServersTestJSON-50214159 None] attachment_update completed successfully. Sep 21 16:35:21 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-a7f86c6f-3df3-4cc8-b44c-42876be52ff7 req-67855189-e001-4bc7-ab69-ce779437e3b1 tempest-DeleteServersTestJSON-50214159 None] Terminate volume connection completed successfully. Sep 21 16:35:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-a7f86c6f-3df3-4cc8-b44c-42876be52ff7 req-67855189-e001-4bc7-ab69-ce779437e3b1 tempest-DeleteServersTestJSON-50214159 None] Deleting attachment 411464ee-25df-4015-9725-6fb6a6920447. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:35:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Acquiring lock "cinder-fa733132-5826-4373-a800-c98113912a12-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:35:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Lock "cinder-fa733132-5826-4373-a800-c98113912a12-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:35:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Acquiring lock "cinder-quobyte-fa733132-5826-4373-a800-c98113912a12" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:35:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Lock "cinder-quobyte-fa733132-5826-4373-a800-c98113912a12" acquired by "delete_volume" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:35:24 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d32660-b584-455a-b9d5-0c4ed50d5399]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:35:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa733132-5826-4373-a800-c98113912a12 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:35:24 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa733132-5826-4373-a800-c98113912a12 Sep 21 16:35:24 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:35:24 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Sep 21 16:35:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa733132-5826-4373-a800-c98113912a12" returned: 0 in 0.466s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:35:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa733132-5826-4373-a800-c98113912a12 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:35:24 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa733132-5826-4373-a800-c98113912a12 Sep 21 16:35:24 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:35:24 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Sep 21 16:35:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa733132-5826-4373-a800-c98113912a12" returned: 0 in 0.359s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:35:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Lock "cinder-quobyte-fa733132-5826-4373-a800-c98113912a12" released by "delete_volume" :: held 0.904s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:35:25 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Created reservations ['a7bd9529-8ccd-4003-920e-caa4c7749ba1', '48b602bd-fffd-4f68-ba11-2e4f600902bf', '8ad8fb7c-426d-4911-89b4-0b0b6c7af402', '1eee59e5-ee0f-405c-b585-2832d595be32'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:35:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:35:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:35:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:35:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:35:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:35:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:35:25 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:35:25 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:35:25 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Sep 21 16:35:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.464s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:35:25 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:35:25 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Deleted volume successfully. Sep 21 16:35:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e47918de-5971-442b-b017-d1b5d1bb726e tempest-DeleteServersTestJSON-50214159 None] Lock "cinder-fa733132-5826-4373-a800-c98113912a12-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:35:31 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-efb204a6-97db-47da-ad49-1c2cafb649c1 req-da84a272-7cdb-4bd8-917c-b07ab758113f tempest-AttachVolumeTestJSON-1403093250 None] Terminate volume connection completed successfully. Sep 21 16:35:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-efb204a6-97db-47da-ad49-1c2cafb649c1 req-da84a272-7cdb-4bd8-917c-b07ab758113f tempest-AttachVolumeTestJSON-1403093250 None] Deleting attachment 40110027-d535-419d-a575-ec7a4cff6b34. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:35:35 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:35:41 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=9,cinder:DELETE=1,cinder:SELECT=17,cinder:INSERT=2 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Flow 'volume_create_manager' (c1b8d132-8891-4122-9f58-4956d98e7f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4ecb52-90d6-4998-b237-7943106cb59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4ecb52-90d6-4998-b237-7943106cb59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-617778734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c141cca7-a91f-4ae0-b619-64ca9782645f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc935fed10446caac3ce75b218c01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:35:51Z,use_quota=True,user_id='ec9f911da9b04ff8b557edd5ff8a8dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb67dcd-3e1b-4e1a-b59c-696af326ebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb67dcd-3e1b-4e1a-b59c-696af326ebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ff6bf4-d06c-499f-854c-1d8562dd12bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ff6bf4-d06c-499f-854c-1d8562dd12bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c141cca7-a91f-4ae0-b619-64ca9782645f', 'volume_name': 'volume-c141cca7-a91f-4ae0-b619-64ca9782645f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d85c0c-0242-4f4f-9da2-2eed0d015e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d85c0c-0242-4f4f-9da2-2eed0d015e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d8254e-cf45-46f8-a9ef-7dee8f9ad7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:51 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Volume c141cca7-a91f-4ae0-b619-64ca9782645f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c141cca7-a91f-4ae0-b619-64ca9782645f', 'volume_size': 1} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-617778734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c141cca7-a91f-4ae0-b619-64ca9782645f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc935fed10446caac3ce75b218c01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:35:51Z,use_quota=True,user_id='ec9f911da9b04ff8b557edd5ff8a8dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Creating volume c141cca7-a91f-4ae0-b619-64ca9782645f {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:35:51 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:35:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c141cca7-a91f-4ae0-b619-64ca9782645f 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:35:51 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c141cca7-a91f-4ae0-b619-64ca9782645f 1073741824 Sep 21 16:35:51 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:35:52 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Sep 21 16:35:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c141cca7-a91f-4ae0-b619-64ca9782645f 1073741824" returned: 0 in 1.022s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:35:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c141cca7-a91f-4ae0-b619-64ca9782645f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:35:52 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c141cca7-a91f-4ae0-b619-64ca9782645f Sep 21 16:35:52 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:35:53 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Sep 21 16:35:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c141cca7-a91f-4ae0-b619-64ca9782645f" returned: 0 in 0.640s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:35:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:35:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:35:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d8254e-cf45-46f8-a9ef-7dee8f9ad7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c141cca7-a91f-4ae0-b619-64ca9782645f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14c5b41-a5b5-4164-a791-e3ec9b6a5b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:53 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Volume volume-c141cca7-a91f-4ae0-b619-64ca9782645f (c141cca7-a91f-4ae0-b619-64ca9782645f): created successfully Sep 21 16:35:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14c5b41-a5b5-4164-a791-e3ec9b6a5b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Flow 'volume_create_manager' (c1b8d132-8891-4122-9f58-4956d98e7f76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:35:53 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4aa97418-c4ea-4ef8-a892-e8e443b2942a tempest-ServersNegativeTestJSON-1515820628 None] Created volume successfully. Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Flow 'volume_create_manager' (7a61052f-2854-4715-ab88-33cebdf1f077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa65000a-565c-44bd-b6d9-7364b4a0bacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa65000a-565c-44bd-b6d9-7364b4a0bacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-342675838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce990885-82f4-4718-b140-ab09a239597b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc935fed10446caac3ce75b218c01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:35:59Z,use_quota=True,user_id='ec9f911da9b04ff8b557edd5ff8a8dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94005ae2-d96e-4606-b08f-7c56acd0e4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94005ae2-d96e-4606-b08f-7c56acd0e4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e5cccd-d338-48d3-bd8c-8e21c3d8d402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e5cccd-d338-48d3-bd8c-8e21c3d8d402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce990885-82f4-4718-b140-ab09a239597b', 'volume_name': 'volume-ce990885-82f4-4718-b140-ab09a239597b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17adf546-fc0b-4bbb-9c02-beb2758d59a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17adf546-fc0b-4bbb-9c02-beb2758d59a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6964ece4-780d-4448-81f7-5fffeb4ef919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:35:58 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Volume ce990885-82f4-4718-b140-ab09a239597b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce990885-82f4-4718-b140-ab09a239597b', 'volume_size': 1} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-342675838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce990885-82f4-4718-b140-ab09a239597b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc935fed10446caac3ce75b218c01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:35:59Z,use_quota=True,user_id='ec9f911da9b04ff8b557edd5ff8a8dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Creating volume ce990885-82f4-4718-b140-ab09a239597b {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:35:58 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:35:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ce990885-82f4-4718-b140-ab09a239597b 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:35:59 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ce990885-82f4-4718-b140-ab09a239597b 1073741824 Sep 21 16:35:59 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:35:59 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Sep 21 16:35:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ce990885-82f4-4718-b140-ab09a239597b 1073741824" returned: 0 in 0.850s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:35:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ce990885-82f4-4718-b140-ab09a239597b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:35:59 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ce990885-82f4-4718-b140-ab09a239597b Sep 21 16:35:59 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:00 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ce990885-82f4-4718-b140-ab09a239597b" returned: 0 in 0.521s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:36:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6964ece4-780d-4448-81f7-5fffeb4ef919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce990885-82f4-4718-b140-ab09a239597b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd59aa8-d164-4c14-8f6e-6c117c5bcb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:00 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Volume volume-ce990885-82f4-4718-b140-ab09a239597b (ce990885-82f4-4718-b140-ab09a239597b): created successfully Sep 21 16:36:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd59aa8-d164-4c14-8f6e-6c117c5bcb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Flow 'volume_create_manager' (7a61052f-2854-4715-ab88-33cebdf1f077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:36:00 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e858d485-db6c-4ba8-8a51-d6a8b65ea208 tempest-ServersNegativeTestJSON-1515820628 None] Created volume successfully. Sep 21 16:36:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Acquiring lock "cinder-ce990885-82f4-4718-b140-ab09a239597b-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:36:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Lock "cinder-ce990885-82f4-4718-b140-ab09a239597b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:36:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Acquiring lock "cinder-quobyte-ce990885-82f4-4718-b140-ab09a239597b" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:36:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Lock "cinder-quobyte-ce990885-82f4-4718-b140-ab09a239597b" acquired by "delete_volume" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:36:01 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efa8c46-dfa6-40eb-afe7-fa6e0f8971ca]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:36:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ce990885-82f4-4718-b140-ab09a239597b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:02 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ce990885-82f4-4718-b140-ab09a239597b Sep 21 16:36:02 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:02 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ce990885-82f4-4718-b140-ab09a239597b" returned: 0 in 0.430s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ce990885-82f4-4718-b140-ab09a239597b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:02 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ce990885-82f4-4718-b140-ab09a239597b Sep 21 16:36:02 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:02 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ce990885-82f4-4718-b140-ab09a239597b" returned: 0 in 0.326s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Lock "cinder-quobyte-ce990885-82f4-4718-b140-ab09a239597b" released by "delete_volume" :: held 0.831s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:36:02 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Created reservations ['46618caf-f693-4288-b0d1-eeacac6fdad4', '4a37e18d-ba3a-4829-a925-dc468624b471', '384fee9e-a39a-47b2-911c-27b7840999bd', 'e70c6809-bf97-43b1-a271-cbcdb0c4abd8'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:36:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:36:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:36:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:02 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:36:02 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Acquiring lock "cinder-c141cca7-a91f-4ae0-b619-64ca9782645f-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:36:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Lock "cinder-c141cca7-a91f-4ae0-b619-64ca9782645f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:36:03 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.415s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:03 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:36:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Deleted volume successfully. Sep 21 16:36:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Acquiring lock "cinder-quobyte-c141cca7-a91f-4ae0-b619-64ca9782645f" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:36:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Lock "cinder-quobyte-c141cca7-a91f-4ae0-b619-64ca9782645f" acquired by "delete_volume" :: waited 0.029s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:36:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a49b0284-04ec-42a6-83e8-2da54ab6fc5a tempest-ServersNegativeTestJSON-1515820628 None] Lock "cinder-ce990885-82f4-4718-b140-ab09a239597b-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:36:03 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e68075-11f5-4e7e-a676-3b658a29698f]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:36:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c141cca7-a91f-4ae0-b619-64ca9782645f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:03 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c141cca7-a91f-4ae0-b619-64ca9782645f Sep 21 16:36:03 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:03 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c141cca7-a91f-4ae0-b619-64ca9782645f" returned: 0 in 0.436s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c141cca7-a91f-4ae0-b619-64ca9782645f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:03 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c141cca7-a91f-4ae0-b619-64ca9782645f Sep 21 16:36:03 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:04 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c141cca7-a91f-4ae0-b619-64ca9782645f" returned: 0 in 0.317s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Lock "cinder-quobyte-c141cca7-a91f-4ae0-b619-64ca9782645f" released by "delete_volume" :: held 0.823s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:36:04 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Created reservations ['8210e152-9ebb-4109-b270-e8ad4572f315', 'c68d759a-e73c-4c1a-8840-97dddc3b47db', 'e4a48e6f-db3c-4a9b-b72f-399718536f9f', 'a3733a8f-35d2-4114-9edc-7b1d56f48986'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:36:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:36:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:36:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:04 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:36:04 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:05 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.664s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:05 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:36:05 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Deleted volume successfully. Sep 21 16:36:05 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-10a57504-33de-4c94-bcdb-8d15f1f5cb9b tempest-ServersNegativeTestJSON-1515820628 None] Lock "cinder-c141cca7-a91f-4ae0-b619-64ca9782645f-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:36:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:36:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:36:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:36:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:07 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:36:07 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:08 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.310s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:36:14 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=16,cinder:UPDATE=17,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=27,cinder:SELECT=12,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Flow 'volume_create_manager' (16ec5e7c-ac45-4282-9bee-93ca2a75b0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c01d05-bdd1-42ae-a045-812ef3deb5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c01d05-bdd1-42ae-a045-812ef3deb5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-451913542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8bfc85-24f4-4f5b-bb0b-8226995abf9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eca2ec2363e4c7aa214e7f9a35b2cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:36:15Z,use_quota=True,user_id='12bcd3e602c044aeae3082c5db0ac844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533c4224-6d43-4596-8088-286c8297cfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533c4224-6d43-4596-8088-286c8297cfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776105dc-f8cf-4fe7-9b67-284a83f0edfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776105dc-f8cf-4fe7-9b67-284a83f0edfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca8bfc85-24f4-4f5b-bb0b-8226995abf9a', 'volume_name': 'volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d31cee-b93c-4d59-a209-e5dffbb9398e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d31cee-b93c-4d59-a209-e5dffbb9398e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2abaa1d-e79e-4fcb-8bd2-879763b580bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:15 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Volume ca8bfc85-24f4-4f5b-bb0b-8226995abf9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a', 'volume_size': 1} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-451913542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8bfc85-24f4-4f5b-bb0b-8226995abf9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eca2ec2363e4c7aa214e7f9a35b2cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:36:15Z,use_quota=True,user_id='12bcd3e602c044aeae3082c5db0ac844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Creating volume ca8bfc85-24f4-4f5b-bb0b-8226995abf9a {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:36:15 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:15 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a 1073741824 Sep 21 16:36:15 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Flow 'volume_create_manager' (256d732f-a3ba-40c5-b75c-f4962ce7b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0bf40bd-10ec-4e97-a2c3-234a62c28a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0bf40bd-10ec-4e97-a2c3-234a62c28a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2029163156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42373e0f-9f2d-4bac-8b55-957779cfa8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4baf7c1849664a04bfddadb877c9bb45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:36:16Z,use_quota=True,user_id='2fbc1f2e5f93446a8a3fb0ed3dd5d375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c04eff-e0c3-4c32-8efa-1ed5d7ba5c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c04eff-e0c3-4c32-8efa-1ed5d7ba5c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f71512b-1277-4bfd-8b13-53cda176bcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:16 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f71512b-1277-4bfd-8b13-53cda176bcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42373e0f-9f2d-4bac-8b55-957779cfa8d6', 'volume_name': 'volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced674c5-3266-4f36-8304-adefb3994829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced674c5-3266-4f36-8304-adefb3994829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f0f533-ae00-4de2-be7b-abf4da5d0e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:16 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Volume 42373e0f-9f2d-4bac-8b55-957779cfa8d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6', 'volume_size': 1} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a 1073741824" returned: 0 in 0.823s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:16 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a Sep 21 16:36:16 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:16 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a" returned: 0 in 0.371s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.428s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2029163156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42373e0f-9f2d-4bac-8b55-957779cfa8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4baf7c1849664a04bfddadb877c9bb45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:36:16Z,use_quota=True,user_id='2fbc1f2e5f93446a8a3fb0ed3dd5d375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Creating volume 42373e0f-9f2d-4bac-8b55-957779cfa8d6 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:36:16 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2abaa1d-e79e-4fcb-8bd2-879763b580bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf0ba26-0150-4f11-9c2a-e82bf2723da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:16 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6 1073741824 Sep 21 16:36:16 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:16 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Volume volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a (ca8bfc85-24f4-4f5b-bb0b-8226995abf9a): created successfully Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf0ba26-0150-4f11-9c2a-e82bf2723da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Flow 'volume_create_manager' (16ec5e7c-ac45-4282-9bee-93ca2a75b0c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:36:16 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3dced8f4-3407-433b-bf74-339bf98c0968 tempest-TaggedAttachmentsTest-1996490288 None] Created volume successfully. Sep 21 16:36:17 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6 1073741824" returned: 0 in 0.663s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:17 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6 Sep 21 16:36:17 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:17 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6" returned: 0 in 0.432s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:36:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f0f533-ae00-4de2-be7b-abf4da5d0e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed06f8fd-68b8-45ca-b4fb-e5c975bf29ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:17 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Volume volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6 (42373e0f-9f2d-4bac-8b55-957779cfa8d6): created successfully Sep 21 16:36:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed06f8fd-68b8-45ca-b4fb-e5c975bf29ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Flow 'volume_create_manager' (256d732f-a3ba-40c5-b75c-f4962ce7b976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:36:17 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8e6be35e-3b1a-47f3-895c-592a4068f45f tempest-ServerActionsTestOtherA-1999102138 None] Created volume successfully. Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Flow 'volume_create_manager' (c856210e-9070-4207-a4bc-09109bf20582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2df976-e106-409f-b579-a6c22fd3bdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2df976-e106-409f-b579-a6c22fd3bdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1238647893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e891816-0335-4d47-b706-1a49251c2ced,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95f542c8b84a444b8a8e4cae081acab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:36:20Z,use_quota=True,user_id='c65fbfac1aaa439a82698f4a009ccbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39eb50bb-153a-4386-8728-21c3372b73cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39eb50bb-153a-4386-8728-21c3372b73cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e1adf1-211d-4ec9-94c4-10151a147404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e1adf1-211d-4ec9-94c4-10151a147404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e891816-0335-4d47-b706-1a49251c2ced', 'volume_name': 'volume-6e891816-0335-4d47-b706-1a49251c2ced', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deeaab98-195c-4ac0-92fb-98fb59ef584f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deeaab98-195c-4ac0-92fb-98fb59ef584f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db68580b-bb16-4348-8f90-81918d729b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:19 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Volume 6e891816-0335-4d47-b706-1a49251c2ced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e891816-0335-4d47-b706-1a49251c2ced', 'volume_size': 1} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1238647893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e891816-0335-4d47-b706-1a49251c2ced,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='95f542c8b84a444b8a8e4cae081acab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:36:20Z,use_quota=True,user_id='c65fbfac1aaa439a82698f4a009ccbb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Creating volume 6e891816-0335-4d47-b706-1a49251c2ced {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:36:19 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:36:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e891816-0335-4d47-b706-1a49251c2ced 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:19 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e891816-0335-4d47-b706-1a49251c2ced 1073741824 Sep 21 16:36:19 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:20 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e891816-0335-4d47-b706-1a49251c2ced 1073741824" returned: 0 in 0.644s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e891816-0335-4d47-b706-1a49251c2ced {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:20 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e891816-0335-4d47-b706-1a49251c2ced Sep 21 16:36:20 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:20 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e891816-0335-4d47-b706-1a49251c2ced" returned: 0 in 0.352s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:36:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db68580b-bb16-4348-8f90-81918d729b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e891816-0335-4d47-b706-1a49251c2ced', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3536660-622d-4dcf-bf81-da096b641b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:20 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Volume volume-6e891816-0335-4d47-b706-1a49251c2ced (6e891816-0335-4d47-b706-1a49251c2ced): created successfully Sep 21 16:36:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3536660-622d-4dcf-bf81-da096b641b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Flow 'volume_create_manager' (c856210e-9070-4207-a4bc-09109bf20582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:36:20 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-359b66b7-f370-407e-95f7-492cee81a2f3 req-8e8aa333-a54b-48e1-903a-0ac910fde5c3 tempest-VolumesGetTestJSON-1782180064 None] Created volume successfully. Sep 21 16:36:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Acquiring lock "cinder-6e891816-0335-4d47-b706-1a49251c2ced-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:36:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Lock "cinder-6e891816-0335-4d47-b706-1a49251c2ced-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:36:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Acquiring lock "cinder-quobyte-6e891816-0335-4d47-b706-1a49251c2ced" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:36:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Lock "cinder-quobyte-6e891816-0335-4d47-b706-1a49251c2ced" acquired by "delete_volume" :: waited 0.049s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:36:22 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecddbb0-f1ad-47ec-a3e2-67977efdb084]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:36:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e891816-0335-4d47-b706-1a49251c2ced {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:23 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e891816-0335-4d47-b706-1a49251c2ced Sep 21 16:36:23 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:23 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e891816-0335-4d47-b706-1a49251c2ced" returned: 0 in 0.626s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e891816-0335-4d47-b706-1a49251c2ced {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:23 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e891816-0335-4d47-b706-1a49251c2ced Sep 21 16:36:23 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:23 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e891816-0335-4d47-b706-1a49251c2ced" returned: 0 in 0.408s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Lock "cinder-quobyte-6e891816-0335-4d47-b706-1a49251c2ced" released by "delete_volume" :: held 1.126s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:36:24 devstack cinder-volume[86030]: DEBUG cinder.quota [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Created reservations ['1323cc3b-4f49-4fe4-bd4c-be818ea5dfc9', 'c81282a7-6f3c-4c75-953b-ba3d190c1bc4', 'e6c1beb3-fab0-4078-8795-8d8bfab8d2b2', 'e79b8420-296e-4d31-8501-4ee57175e7bd'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:36:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:36:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:36:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:24 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:36:24 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:24 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.352s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:24 devstack cinder-volume[86030]: DEBUG cinder.manager [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:36:24 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Deleted volume successfully. Sep 21 16:36:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-dc463aa1-2b74-4413-948d-035c99591581 req-c6b7b177-22df-447f-b901-f365356ab391 tempest-VolumesGetTestJSON-1782180064 None] Lock "cinder-6e891816-0335-4d47-b706-1a49251c2ced-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:36:34 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=8,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:36:34 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=14,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:36:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6751ccc2-e5ea-4bab-8abe-a4db1a35f16f tempest-BackendsCapabilitiesAdminTestsJSON-74432604 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6392135620117, 'free_capacity_gb': 1775.6392135620117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86030) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 21 16:36:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-57ec60cb-54e4-43cf-b4c3-3161e56715a6 tempest-BackendsCapabilitiesAdminTestsJSON-74432604 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6392135620117, 'free_capacity_gb': 1775.6392135620117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86030) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 21 16:36:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b6bef861-4986-4b3a-ab67-5a234dd46427 tempest-GroupSnapshotsTest-422176158 None] Group tempest-GroupSnapshotsTest-Group-1744414640: creating Sep 21 16:36:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b6bef861-4986-4b3a-ab67-5a234dd46427 tempest-GroupSnapshotsTest-422176158 None] Group tempest-GroupSnapshotsTest-Group-1744414640: created successfully Sep 21 16:36:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b6bef861-4986-4b3a-ab67-5a234dd46427 tempest-GroupSnapshotsTest-422176158 None] Create group completed successfully. Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Flow 'volume_create_manager' (5211278c-91f8-460c-b686-93e954b9152c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c133b16-1c74-4993-aaa1-3e0b55e8e6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c133b16-1c74-4993-aaa1-3e0b55e8e6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-177470705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7dc00f9a-d9bf-47d0-9cdb-490d4d7da4c8,host='devstack@QuobyteHD#QuobyteHD',id=d1eeef21-9fa9-44bb-ad30-a4546473a3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4796dc2b81904ee0a4f13adf2ac84c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:36:49Z,use_quota=True,user_id='3db6a5d636df4ac1b62f0a311730a49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4475424-a9aa-4dbd-ba38-128fa903a5ec),volume_type_id=f4475424-a9aa-4dbd-ba38-128fa903a5ec)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b424d037-7ccd-46f4-bbc9-d370078f334e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b424d037-7ccd-46f4-bbc9-d370078f334e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef422a0d-9b0d-4da3-ae03-0e96b259626f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef422a0d-9b0d-4da3-ae03-0e96b259626f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1eeef21-9fa9-44bb-ad30-a4546473a3b3', 'volume_name': 'volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4c3121-2399-458d-bc19-a668736eb682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4c3121-2399-458d-bc19-a668736eb682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb05b8c3-4fc2-40cd-a8f6-cdb73252d1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:48 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Volume d1eeef21-9fa9-44bb-ad30-a4546473a3b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3', 'volume_size': 1} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7dc00f9a-d9bf-47d0-9cdb-490d4d7da4c8,created_at=2026-09-21T14:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-177470705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7dc00f9a-d9bf-47d0-9cdb-490d4d7da4c8,host='devstack@QuobyteHD#QuobyteHD',id=d1eeef21-9fa9-44bb-ad30-a4546473a3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4796dc2b81904ee0a4f13adf2ac84c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:36:49Z,use_quota=True,user_id='3db6a5d636df4ac1b62f0a311730a49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4475424-a9aa-4dbd-ba38-128fa903a5ec),volume_type_id=f4475424-a9aa-4dbd-ba38-128fa903a5ec)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Creating volume d1eeef21-9fa9-44bb-ad30-a4546473a3b3 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:36:48 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:36:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:48 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 1073741824 Sep 21 16:36:48 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:49 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 1073741824" returned: 0 in 0.428s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:49 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 Sep 21 16:36:49 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:49 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3" returned: 0 in 0.264s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:36:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb05b8c3-4fc2-40cd-a8f6-cdb73252d1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27737edb-67a4-4dcc-a4c6-d8ed89bc0f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:36:49 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Volume volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 (d1eeef21-9fa9-44bb-ad30-a4546473a3b3): created successfully Sep 21 16:36:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27737edb-67a4-4dcc-a4c6-d8ed89bc0f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:36:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Flow 'volume_create_manager' (5211278c-91f8-460c-b686-93e954b9152c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:36:49 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6ac7bd36-dd16-4bbd-93d1-446ad26240b3 tempest-GroupSnapshotsTest-422176158 None] Created volume successfully. Sep 21 16:36:50 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] GroupSnapshot 7a246d9a-7e98-43c1-a295-491d75a5bcce: creating. Sep 21 16:36:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] Group snapshot 7a246d9a-7e98-43c1-a295-491d75a5bcce: creating. {{(pid=86030) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 21 16:36:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:50 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] Creating offline snapshot 0b13fcf4-5254-40b3-ae45-6f9053ba0271 of volume d1eeef21-9fa9-44bb-ad30-a4546473a3b3 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:36:50 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dea531-dcf1-40c1-a2f7-2a173cc71c48]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:36:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:50 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 Sep 21 16:36:50 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:50 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3" returned: 0 in 0.373s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:50 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 1G Sep 21 16:36:50 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:50 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 1G" returned: 0 in 0.388s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:50 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 Sep 21 16:36:51 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:51 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271" returned: 0 in 0.295s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:51 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:36:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:51 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 Sep 21 16:36:51 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:51 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271" returned: 0 in 0.242s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:51 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.info Sep 21 16:36:51 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:51 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.info" returned: 0 in 0.283s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:51 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:36:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:51 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.info Sep 21 16:36:51 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:52 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.info" returned: 0 in 0.246s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:52 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-07de8ea1-e81f-4031-9200-c10a398f3e7d tempest-GroupSnapshotsTest-422176158 None] group_snapshot 7a246d9a-7e98-43c1-a295-491d75a5bcce: created successfully Sep 21 16:36:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-0b13fcf4-5254-40b3-ae45-6f9053ba0271-df9bff42-1544-49c4-98eb-ed1befcae37f" by "_create_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-0b13fcf4-5254-40b3-ae45-6f9053ba0271-df9bff42-1544-49c4-98eb-ed1befcae37f" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Creating volume df9bff42-1544-49c4-98eb-ed1befcae37f from snapshot 0b13fcf4-5254-40b3-ae45-6f9053ba0271 {{(pid=86030) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-df9bff42-1544-49c4-98eb-ed1befcae37f" by "_copy_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-df9bff42-1544-49c4-98eb-ed1befcae37f" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] snapshot: 0b13fcf4-5254-40b3-ae45-6f9053ba0271, volume: df9bff42-1544-49c4-98eb-ed1befcae37f, {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d759f6-1085-4f29-9f75-f3f4cddbacba]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:53 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 Sep 21 16:36:53 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:53 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271" returned: 0 in 0.353s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6b7447-9920-4e21-9671-46dc5033ca69]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:53 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 Sep 21 16:36:53 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:36:53 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3" returned: 0 in 0.351s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Creating direct copy from snapshot {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG cinder.utils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Path /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f not found in is_blk_device check {{(pid=86030) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 21 16:36:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:36:53 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f Sep 21 16:36:53 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:00 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:37:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Flow 'volume_create_manager' (8a118638-1aad-4d95-a00f-580af9cd8137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b622b64-d0fe-4bb8-a659-6ae52db8b583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b622b64-d0fe-4bb8-a659-6ae52db8b583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1940805461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac5880f-fc38-4419-916a-ff1729e54138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8f06c8aa844c4992b59d9805758a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:00Z,use_quota=True,user_id='0f266d762fed491f8ca8d1a6234d48a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fa8885-fe91-4d2b-a107-2bc8804face7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fa8885-fe91-4d2b-a107-2bc8804face7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c36fa7a-6031-4174-a035-b4e8567ff7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c36fa7a-6031-4174-a035-b4e8567ff7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aac5880f-fc38-4419-916a-ff1729e54138', 'volume_name': 'volume-aac5880f-fc38-4419-916a-ff1729e54138', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c349797-3aaa-4dcc-83f3-0d0e9d870c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c349797-3aaa-4dcc-83f3-0d0e9d870c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d4ddf2-f6a8-40bc-be04-8641d8c9977b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:00 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Volume aac5880f-fc38-4419-916a-ff1729e54138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aac5880f-fc38-4419-916a-ff1729e54138', 'volume_size': 1} Sep 21 16:37:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:02 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f" returned: 0 in 8.307s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3, size 1024.00 MB, duration 8.31 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:37:02 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Converted 1024.00 MB image at 123.23 MB/s Sep 21 16:37:02 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:02 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f Sep 21 16:37:02 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:02 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f" returned: 0 in 0.262s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-df9bff42-1544-49c4-98eb-ed1befcae37f" released by "_copy_volume_from_snapshot" :: held 9.357s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-0b13fcf4-5254-40b3-ae45-6f9053ba0271-df9bff42-1544-49c4-98eb-ed1befcae37f" released by "_create_volume_from_snapshot" :: held 9.449s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.467s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.639s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1940805461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac5880f-fc38-4419-916a-ff1729e54138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8f06c8aa844c4992b59d9805758a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:00Z,use_quota=True,user_id='0f266d762fed491f8ca8d1a6234d48a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Creating volume aac5880f-fc38-4419-916a-ff1729e54138 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:37:02 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aac5880f-fc38-4419-916a-ff1729e54138 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:02 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aac5880f-fc38-4419-916a-ff1729e54138 1073741824 Sep 21 16:37:02 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-ad3865c3-bc27-4473-8cae-9c0bd5745640 req-c3a4c301-d663-4675-9f9d-b438c23d18d1 tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:02 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fb330a00-8c8e-486c-a3ab-f2311f43e182 tempest-GroupSnapshotsTest-422176158 None] Create group from source-snapshot-7a246d9a-7e98-43c1-a295-491d75a5bcce completed successfully. Sep 21 16:37:02 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aac5880f-fc38-4419-916a-ff1729e54138 1073741824" returned: 0 in 0.520s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aac5880f-fc38-4419-916a-ff1729e54138 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:03 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aac5880f-fc38-4419-916a-ff1729e54138 Sep 21 16:37:03 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:03 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aac5880f-fc38-4419-916a-ff1729e54138" returned: 0 in 0.307s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-ad3865c3-bc27-4473-8cae-9c0bd5745640 req-c3a4c301-d663-4675-9f9d-b438c23d18d1 tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.820s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-df9bff42-1544-49c4-98eb-ed1befcae37f" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d4ddf2-f6a8-40bc-be04-8641d8c9977b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aac5880f-fc38-4419-916a-ff1729e54138', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fffec7e-70e2-4f15-96a3-cead5a9931ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:03 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Volume volume-aac5880f-fc38-4419-916a-ff1729e54138 (aac5880f-fc38-4419-916a-ff1729e54138): created successfully Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fffec7e-70e2-4f15-96a3-cead5a9931ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Flow 'volume_create_manager' (8a118638-1aad-4d95-a00f-580af9cd8137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-df9bff42-1544-49c4-98eb-ed1befcae37f" acquired by "delete_volume" :: waited 0.053s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-ad3865c3-bc27-4473-8cae-9c0bd5745640 req-c3a4c301-d663-4675-9f9d-b438c23d18d1 tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.139s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b6d5b605-8a70-4d87-9dbd-ed4f7c2eddfc tempest-AttachVolumeTestJSON-1403093250 None] Created volume successfully. Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8a6c68-f121-49b9-8ed0-6fe3c9b31e6c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-ad3865c3-bc27-4473-8cae-9c0bd5745640 req-c3a4c301-d663-4675-9f9d-b438c23d18d1 tempest-ServerActionsTestOtherA-1999102138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aebc99bc-5298-4b1f-97c9-6857c4172610', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:37:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-ad3865c3-bc27-4473-8cae-9c0bd5745640 req-c3a4c301-d663-4675-9f9d-b438c23d18d1 tempest-ServerActionsTestOtherA-1999102138 None] attachment_update completed successfully. Sep 21 16:37:03 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f Sep 21 16:37:03 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:04 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f" returned: 0 in 0.545s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:04 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f Sep 21 16:37:04 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:04 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df9bff42-1544-49c4-98eb-ed1befcae37f" returned: 0 in 0.340s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-df9bff42-1544-49c4-98eb-ed1befcae37f" released by "delete_volume" :: held 0.970s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:04 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Created reservations ['8fdf5346-ba9b-4564-a7d8-124c6542691a'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:04 devstack cinder-volume[86030]: WARNING cinder.quota [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1472363068 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1472363068, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:37:04 devstack cinder-volume[86030]: WARNING cinder.quota [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1472363068 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1472363068, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:37:04 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Created reservations ['a53fca1b-27c4-48b2-b406-73053684e830', '2f7ea9c9-6fac-4ab0-a812-dcc79e5e0de9', '9424fe36-66b7-46d6-806a-955d0917aa83', '7062d5af-367b-4e28-b754-847163922d0b'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:05 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:37:05 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-0a087248-7c46-4807-b73c-fc04b8827fb1 req-bc82e086-a3f6-4f9a-bccd-b2ad2295e518 tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-0a087248-7c46-4807-b73c-fc04b8827fb1 req-bc82e086-a3f6-4f9a-bccd-b2ad2295e518 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-0a087248-7c46-4807-b73c-fc04b8827fb1 req-bc82e086-a3f6-4f9a-bccd-b2ad2295e518 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-0a087248-7c46-4807-b73c-fc04b8827fb1 req-bc82e086-a3f6-4f9a-bccd-b2ad2295e518 tempest-AttachVolumeTestJSON-1403093250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-aac5880f-fc38-4419-916a-ff1729e54138', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9dbdecfa-874b-4af2-b254-f9afee8056d2', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:37:05 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-0a087248-7c46-4807-b73c-fc04b8827fb1 req-bc82e086-a3f6-4f9a-bccd-b2ad2295e518 tempest-AttachVolumeTestJSON-1403093250 None] attachment_update completed successfully. Sep 21 16:37:05 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.309s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:05 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:37:05 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b229103a-038d-41cb-be48-ee56175af20b tempest-GroupSnapshotsTest-422176158 None] Delete group completed successfully. Sep 21 16:37:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] group_snapshot 7a246d9a-7e98-43c1-a295-491d75a5bcce: deleting Sep 21 16:37:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] group_snapshot 7a246d9a-7e98-43c1-a295-491d75a5bcce: deleting {{(pid=86030) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 21 16:37:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-d1eeef21-9fa9-44bb-ad30-a4546473a3b3" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-d1eeef21-9fa9-44bb-ad30-a4546473a3b3" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-0b13fcf4-5254-40b3-ae45-6f9053ba0271" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-0b13fcf4-5254-40b3-ae45-6f9053ba0271" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Deleting offline snapshot 0b13fcf4-5254-40b3-ae45-6f9053ba0271 of volume d1eeef21-9fa9-44bb-ad30-a4546473a3b3 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:37:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] snapshot_file for this snap is: volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:37:06 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b98dbb2-9042-415f-865f-3a537090a808]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:06 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 Sep 21 16:37:06 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:07 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271" returned: 0 in 0.730s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:37:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fd92c9-7c4e-46a4-a265-e1f0ec1b186d]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:07 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 Sep 21 16:37:07 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:37:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:07 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:37:07 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:08 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3" returned: 0 in 0.763s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:08 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 Sep 21 16:37:08 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:08 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.418s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 8 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-bc361252-5664-4350-98d9-add20ef1522f req-9a2cd2f1-81eb-4a87-b555-a283c740dd3b tempest-TaggedAttachmentsTest-1996490288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-bc361252-5664-4350-98d9-add20ef1522f req-9a2cd2f1-81eb-4a87-b555-a283c740dd3b tempest-TaggedAttachmentsTest-1996490288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-bc361252-5664-4350-98d9-add20ef1522f req-9a2cd2f1-81eb-4a87-b555-a283c740dd3b tempest-TaggedAttachmentsTest-1996490288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-bc361252-5664-4350-98d9-add20ef1522f req-9a2cd2f1-81eb-4a87-b555-a283c740dd3b tempest-TaggedAttachmentsTest-1996490288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42f590c7-c36b-470e-8c5d-cc4e6f8b0e86', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:37:08 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-bc361252-5664-4350-98d9-add20ef1522f req-9a2cd2f1-81eb-4a87-b555-a283c740dd3b tempest-TaggedAttachmentsTest-1996490288 None] attachment_update completed successfully. Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Flow 'volume_create_manager' (d90fabaf-7122-4c60-b105-e78f3c33ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69d2b26-000c-441a-b916-f52bab769cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:08 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271" returned: 0 in 0.532s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69d2b26-000c-441a-b916-f52bab769cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2029710423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15891b5f-241a-4aa4-a531-e3e52962dfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8f06c8aa844c4992b59d9805758a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:09Z,use_quota=True,user_id='0f266d762fed491f8ca8d1a6234d48a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7614021-f04c-47cf-8606-b5587de0180f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7614021-f04c-47cf-8606-b5587de0180f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:08 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271 Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36d133c-7bc9-408f-a24c-58cebd51d65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:08 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36d133c-7bc9-408f-a24c-58cebd51d65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15891b5f-241a-4aa4-a531-e3e52962dfde', 'volume_name': 'volume-15891b5f-241a-4aa4-a531-e3e52962dfde', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2787fc51-2bc1-4e89-8c50-a77200ad8a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2787fc51-2bc1-4e89-8c50-a77200ad8a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437caf38-490e-4127-9849-b273d8eed441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:08 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Volume 15891b5f-241a-4aa4-a531-e3e52962dfde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15891b5f-241a-4aa4-a531-e3e52962dfde', 'volume_size': 1} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2029710423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15891b5f-241a-4aa4-a531-e3e52962dfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8f06c8aa844c4992b59d9805758a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:09Z,use_quota=True,user_id='0f266d762fed491f8ca8d1a6234d48a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Creating volume 15891b5f-241a-4aa4-a531-e3e52962dfde {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:37:08 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15891b5f-241a-4aa4-a531-e3e52962dfde 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:08 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15891b5f-241a-4aa4-a531-e3e52962dfde 1073741824 Sep 21 16:37:08 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:08 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-b0c1a99a-8411-4166-bdcf-173b2030d4fe req-3790f492-1d79-4d6d-9ce9-94a608606a3a tempest-ServerActionsTestOtherA-1999102138 None] Terminate volume connection completed successfully. Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-b0c1a99a-8411-4166-bdcf-173b2030d4fe req-3790f492-1d79-4d6d-9ce9-94a608606a3a tempest-ServerActionsTestOtherA-1999102138 None] Deleting attachment aebc99bc-5298-4b1f-97c9-6857c4172610. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:37:08 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3.0b13fcf4-5254-40b3-ae45-6f9053ba0271" returned: 0 in 0.355s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-0b13fcf4-5254-40b3-ae45-6f9053ba0271" released by "_delete_snapshot" :: held 2.590s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-d1eeef21-9fa9-44bb-ad30-a4546473a3b3" released by "delete_snapshot" :: held 2.641s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:09 devstack cinder-volume[86030]: WARNING cinder.quota [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1472363068 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1472363068, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:37:09 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] Created reservations ['968945b6-9925-496a-9c9d-7b7881fc956f', 'ce5e20a9-7b09-4acd-bd67-c8add36e9654', 'b57661c0-d00c-4589-a5ce-c466037752e6', '68b63375-6b2c-4683-b495-84bf36f41dfa'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:09 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-43325aee-6f74-4d58-8b9c-a6396d1fe03f tempest-GroupSnapshotsTest-422176158 None] group_snapshot 7a246d9a-7e98-43c1-a295-491d75a5bcce: deleted successfully Sep 21 16:37:09 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15891b5f-241a-4aa4-a531-e3e52962dfde 1073741824" returned: 0 in 0.884s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15891b5f-241a-4aa4-a531-e3e52962dfde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:09 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15891b5f-241a-4aa4-a531-e3e52962dfde Sep 21 16:37:09 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-b0c1a99a-8411-4166-bdcf-173b2030d4fe req-04b3b7d6-c820-4d78-b65b-47314e38737a tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:10 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15891b5f-241a-4aa4-a531-e3e52962dfde" returned: 0 in 0.380s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-b0c1a99a-8411-4166-bdcf-173b2030d4fe req-04b3b7d6-c820-4d78-b65b-47314e38737a tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.034s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437caf38-490e-4127-9849-b273d8eed441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15891b5f-241a-4aa4-a531-e3e52962dfde', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb1e03b-541f-4893-a829-ed18744245a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-b0c1a99a-8411-4166-bdcf-173b2030d4fe req-04b3b7d6-c820-4d78-b65b-47314e38737a tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:10 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Volume volume-15891b5f-241a-4aa4-a531-e3e52962dfde (15891b5f-241a-4aa4-a531-e3e52962dfde): created successfully Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb1e03b-541f-4893-a829-ed18744245a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Flow 'volume_create_manager' (d90fabaf-7122-4c60-b105-e78f3c33ce20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:10 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4e958dfd-693d-4caf-881d-6017a91406a4 tempest-AttachVolumeTestJSON-1403093250 None] Created volume successfully. Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-b0c1a99a-8411-4166-bdcf-173b2030d4fe req-04b3b7d6-c820-4d78-b65b-47314e38737a tempest-ServerActionsTestOtherA-1999102138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0faac98f-cad3-41ca-8033-c25406c2aa5b', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-d1eeef21-9fa9-44bb-ad30-a4546473a3b3" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-d1eeef21-9fa9-44bb-ad30-a4546473a3b3" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:10 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-b0c1a99a-8411-4166-bdcf-173b2030d4fe req-04b3b7d6-c820-4d78-b65b-47314e38737a tempest-ServerActionsTestOtherA-1999102138 None] attachment_update completed successfully. Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1890540c-7f79-497e-a25f-8d7a00d99e1f]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:10 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 Sep 21 16:37:10 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:10 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3" returned: 0 in 0.486s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:10 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3 Sep 21 16:37:10 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:11 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d1eeef21-9fa9-44bb-ad30-a4546473a3b3" returned: 0 in 0.331s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-d1eeef21-9fa9-44bb-ad30-a4546473a3b3" released by "delete_volume" :: held 0.902s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Created reservations ['d5bf3063-979c-4f37-b639-061f1aaa65d3'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:11 devstack cinder-volume[86030]: WARNING cinder.db.api [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1472363068'] Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Created reservations ['a07f6fa7-52a7-4da4-9991-c6d7e4d5a1ac', 'bd0bd7e1-b67c-4ea4-9a58-338e9be8168c', 'f9c69e2f-20bf-4d2f-9d54-ee18b72e5ebf', 'b175c943-9495-4f11-b65b-b59afbd90dea'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:11 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:37:11 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-e2b64467-c9da-4a4c-9ef9-b76def724b29 req-30a48c34-1c86-4b73-8ab1-4f366be00e3f tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-e2b64467-c9da-4a4c-9ef9-b76def724b29 req-30a48c34-1c86-4b73-8ab1-4f366be00e3f tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-e2b64467-c9da-4a4c-9ef9-b76def724b29 req-30a48c34-1c86-4b73-8ab1-4f366be00e3f tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-e2b64467-c9da-4a4c-9ef9-b76def724b29 req-30a48c34-1c86-4b73-8ab1-4f366be00e3f tempest-AttachVolumeTestJSON-1403093250 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-15891b5f-241a-4aa4-a531-e3e52962dfde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e264dcb0-e81e-4347-b21e-3e8492a46cb5', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:37:11 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-e2b64467-c9da-4a4c-9ef9-b76def724b29 req-30a48c34-1c86-4b73-8ab1-4f366be00e3f tempest-AttachVolumeTestJSON-1403093250 None] attachment_update completed successfully. Sep 21 16:37:12 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.536s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:12 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:37:12 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6fa3401f-efcb-438e-a85b-b52a2be91331 tempest-GroupSnapshotsTest-422176158 None] Delete group completed successfully. Sep 21 16:37:12 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-5de8b564-dc33-4f7d-8fd6-121daeaa82b0 req-aa2c755b-7b33-4f75-99f7-ddfc31983ef3 tempest-TaggedAttachmentsTest-1996490288 None] Terminate volume connection completed successfully. Sep 21 16:37:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-5de8b564-dc33-4f7d-8fd6-121daeaa82b0 req-aa2c755b-7b33-4f75-99f7-ddfc31983ef3 tempest-TaggedAttachmentsTest-1996490288 None] Deleting attachment 42f590c7-c36b-470e-8c5d-cc4e6f8b0e86. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:37:13 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d002ecad-952e-426e-97ac-aee37393403d tempest-GroupSnapshotsTest-422176158 None] Group tempest-GroupSnapshotsTest-Group-1144414211: creating Sep 21 16:37:13 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d002ecad-952e-426e-97ac-aee37393403d tempest-GroupSnapshotsTest-422176158 None] Group tempest-GroupSnapshotsTest-Group-1144414211: created successfully Sep 21 16:37:13 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d002ecad-952e-426e-97ac-aee37393403d tempest-GroupSnapshotsTest-422176158 None] Create group completed successfully. Sep 21 16:37:15 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-9a6a7080-b391-4c46-8bf9-45ee29bfebc1 req-247a4ef1-293d-4230-b2d5-6e671a75dfa0 tempest-AttachVolumeTestJSON-1403093250 None] Terminate volume connection completed successfully. Sep 21 16:37:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-9a6a7080-b391-4c46-8bf9-45ee29bfebc1 req-247a4ef1-293d-4230-b2d5-6e671a75dfa0 tempest-AttachVolumeTestJSON-1403093250 None] Deleting attachment 9dbdecfa-874b-4af2-b254-f9afee8056d2. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Flow 'volume_create_manager' (099ceae5-6ed5-4214-ac10-fe8df01509be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4beb244b-9ee4-4238-aa92-06d41f5bf1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4beb244b-9ee4-4238-aa92-06d41f5bf1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1538266772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4708a873-433b-4896-9093-fbbc73ffeedf,host='devstack@QuobyteHD#QuobyteHD',id=8276a40d-f57c-4e82-ac08-93fe07e7f79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4796dc2b81904ee0a4f13adf2ac84c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:16Z,use_quota=True,user_id='3db6a5d636df4ac1b62f0a311730a49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64dbb518-d5b5-465e-934a-c961cf421a70),volume_type_id=64dbb518-d5b5-465e-934a-c961cf421a70)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de313d14-4c21-4f7e-ac98-5df26abfcd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de313d14-4c21-4f7e-ac98-5df26abfcd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df60dcc-f5d8-40f2-8201-38f593ed3d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df60dcc-f5d8-40f2-8201-38f593ed3d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8276a40d-f57c-4e82-ac08-93fe07e7f79d', 'volume_name': 'volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d02a2e3-5c2c-433b-b36f-af6a9bb7036b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d02a2e3-5c2c-433b-b36f-af6a9bb7036b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b62b567-b860-4a26-ac27-cb7a2bef5deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:16 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Volume 8276a40d-f57c-4e82-ac08-93fe07e7f79d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d', 'volume_size': 1} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4708a873-433b-4896-9093-fbbc73ffeedf,created_at=2026-09-21T14:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1538266772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4708a873-433b-4896-9093-fbbc73ffeedf,host='devstack@QuobyteHD#QuobyteHD',id=8276a40d-f57c-4e82-ac08-93fe07e7f79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4796dc2b81904ee0a4f13adf2ac84c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:16Z,use_quota=True,user_id='3db6a5d636df4ac1b62f0a311730a49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64dbb518-d5b5-465e-934a-c961cf421a70),volume_type_id=64dbb518-d5b5-465e-934a-c961cf421a70)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Creating volume 8276a40d-f57c-4e82-ac08-93fe07e7f79d {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:37:16 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:16 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d 1073741824 Sep 21 16:37:16 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:16 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d 1073741824" returned: 0 in 0.678s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:17 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-e75f1a69-ed62-4474-af30-ecf4d9bd2a94 req-fdbe5647-2e75-404e-a5df-bb27744ca1cd tempest-AttachVolumeTestJSON-1403093250 None] Terminate volume connection completed successfully. Sep 21 16:37:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-e75f1a69-ed62-4474-af30-ecf4d9bd2a94 req-fdbe5647-2e75-404e-a5df-bb27744ca1cd tempest-AttachVolumeTestJSON-1403093250 None] Deleting attachment e264dcb0-e81e-4347-b21e-3e8492a46cb5. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:37:17 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d Sep 21 16:37:17 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:17 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d" returned: 0 in 0.350s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:37:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b62b567-b860-4a26-ac27-cb7a2bef5deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9929c2b-39fe-45a7-a913-8e57f35267eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:17 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Volume volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d (8276a40d-f57c-4e82-ac08-93fe07e7f79d): created successfully Sep 21 16:37:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9929c2b-39fe-45a7-a913-8e57f35267eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Flow 'volume_create_manager' (099ceae5-6ed5-4214-ac10-fe8df01509be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:17 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a43323a8-e35a-4fd9-a254-e2f5259149ed tempest-GroupSnapshotsTest-422176158 None] Created volume successfully. Sep 21 16:37:19 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:37:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Flow 'volume_create_manager' (41624ed9-5fe4-4ee9-b834-88354807e7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ad3557-5427-4a0b-9200-6055e53395fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ad3557-5427-4a0b-9200-6055e53395fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-383675399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4708a873-433b-4896-9093-fbbc73ffeedf,host='devstack@QuobyteHD#QuobyteHD',id=df71f958-9a33-49f2-b067-c42e24fc2d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4796dc2b81904ee0a4f13adf2ac84c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:20Z,use_quota=True,user_id='3db6a5d636df4ac1b62f0a311730a49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64dbb518-d5b5-465e-934a-c961cf421a70),volume_type_id=64dbb518-d5b5-465e-934a-c961cf421a70)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c01873-541c-4c9f-8ae8-09f485f5d91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c01873-541c-4c9f-8ae8-09f485f5d91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f13a7d-15da-427c-ab81-593ba99c9898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f13a7d-15da-427c-ab81-593ba99c9898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df71f958-9a33-49f2-b067-c42e24fc2d4c', 'volume_name': 'volume-df71f958-9a33-49f2-b067-c42e24fc2d4c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8462f7a-974e-4654-bb67-cf6ad13fa42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8462f7a-974e-4654-bb67-cf6ad13fa42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d776289-ab99-4df9-bc89-67f2f34d5ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:20 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Volume df71f958-9a33-49f2-b067-c42e24fc2d4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df71f958-9a33-49f2-b067-c42e24fc2d4c', 'volume_size': 1} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4708a873-433b-4896-9093-fbbc73ffeedf,created_at=2026-09-21T14:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-383675399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4708a873-433b-4896-9093-fbbc73ffeedf,host='devstack@QuobyteHD#QuobyteHD',id=df71f958-9a33-49f2-b067-c42e24fc2d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4796dc2b81904ee0a4f13adf2ac84c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:20Z,use_quota=True,user_id='3db6a5d636df4ac1b62f0a311730a49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64dbb518-d5b5-465e-934a-c961cf421a70),volume_type_id=64dbb518-d5b5-465e-934a-c961cf421a70)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Creating volume df71f958-9a33-49f2-b067-c42e24fc2d4c {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:37:20 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:20 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c 1073741824 Sep 21 16:37:20 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:20 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c 1073741824" returned: 0 in 0.786s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:20 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c Sep 21 16:37:20 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:21 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c" returned: 0 in 0.415s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:37:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d776289-ab99-4df9-bc89-67f2f34d5ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df71f958-9a33-49f2-b067-c42e24fc2d4c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4577c290-8bb9-4eaf-b01c-db8d5ac70369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:21 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Volume volume-df71f958-9a33-49f2-b067-c42e24fc2d4c (df71f958-9a33-49f2-b067-c42e24fc2d4c): created successfully Sep 21 16:37:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4577c290-8bb9-4eaf-b01c-db8d5ac70369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Flow 'volume_create_manager' (41624ed9-5fe4-4ee9-b834-88354807e7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:21 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-48b34d34-fd03-4345-93f9-af3d0c3c2cb7 tempest-GroupSnapshotsTest-422176158 None] Created volume successfully. Sep 21 16:37:22 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-772fe45a-9182-4665-8b7c-36d9065a05e4 tempest-GroupSnapshotsTest-422176158 None] Update group completed successfully. Sep 21 16:37:24 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8ed4981c-9838-4f6b-bd94-8e1916d17711 tempest-GroupSnapshotsTest-422176158 None] Update group completed successfully. Sep 21 16:37:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Acquiring lock "cinder-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Lock "cinder-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Acquiring lock "cinder-quobyte-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Lock "cinder-quobyte-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a" acquired by "delete_volume" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[5279d782-aaa3-4c85-b11e-5f57e26b6a09]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "cinder-15891b5f-241a-4aa4-a531-e3e52962dfde-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Lock "cinder-15891b5f-241a-4aa4-a531-e3e52962dfde-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "cinder-quobyte-15891b5f-241a-4aa4-a531-e3e52962dfde" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Lock "cinder-quobyte-15891b5f-241a-4aa4-a531-e3e52962dfde" acquired by "delete_volume" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fc2c9f-5dd4-415d-a94c-4e94cb1d7260]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15891b5f-241a-4aa4-a531-e3e52962dfde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:25 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a Sep 21 16:37:25 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:25 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15891b5f-241a-4aa4-a531-e3e52962dfde Sep 21 16:37:25 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:25 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-7a9bcaa1-b44f-4eae-92df-6dd655877653 tempest-GroupSnapshotsTest-422176158 None] Update group completed successfully. Sep 21 16:37:25 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a" returned: 0 in 0.493s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:25 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a Sep 21 16:37:25 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:25 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15891b5f-241a-4aa4-a531-e3e52962dfde" returned: 0 in 0.494s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15891b5f-241a-4aa4-a531-e3e52962dfde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:25 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15891b5f-241a-4aa4-a531-e3e52962dfde Sep 21 16:37:25 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:25 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a" returned: 0 in 0.267s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Lock "cinder-quobyte-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a" released by "delete_volume" :: held 0.824s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:25 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Created reservations ['3e43a8b9-8f60-43e6-aad0-91ceea481c1a', '571f4b74-d744-463f-8ae1-b76c9cf81c8a', 'ba38c815-1a1e-4d33-8730-50d1b93146c3', 'd41df045-c7e8-4016-bf07-749dac63ac5a'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:26 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:37:26 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:26 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15891b5f-241a-4aa4-a531-e3e52962dfde" returned: 0 in 0.294s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Lock "cinder-quobyte-15891b5f-241a-4aa4-a531-e3e52962dfde" released by "delete_volume" :: held 0.871s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Created reservations ['6d377e0a-491f-45f9-a406-8537fc007efa', '8d530cb1-003a-4a7c-b1f9-c32f3f81bddc', 'e16b4411-7429-4f40-ad21-708494b93133', 'ebc3e0e9-535b-4aaa-a548-72fea027365c'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:26 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:37:26 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:26 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.310s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:37:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Deleted volume successfully. Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f7ebb6af-78e1-45dd-96aa-c58fcf3184b4 tempest-TaggedAttachmentsTest-1996490288 None] Lock "cinder-ca8bfc85-24f4-4f5b-bb0b-8226995abf9a-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "cinder-aac5880f-fc38-4419-916a-ff1729e54138-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Lock "cinder-aac5880f-fc38-4419-916a-ff1729e54138-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "cinder-quobyte-aac5880f-fc38-4419-916a-ff1729e54138" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Lock "cinder-quobyte-aac5880f-fc38-4419-916a-ff1729e54138" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb95a20-06b3-467a-aca6-539c09a5a19c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aac5880f-fc38-4419-916a-ff1729e54138 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:26 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.400s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:37:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Deleted volume successfully. Sep 21 16:37:26 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aac5880f-fc38-4419-916a-ff1729e54138 Sep 21 16:37:26 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5091c98f-f86a-4988-98f1-4cc3a466c050 tempest-AttachVolumeTestJSON-1403093250 None] Lock "cinder-15891b5f-241a-4aa4-a531-e3e52962dfde-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b9065e9e-f077-42e0-af6a-f11ce2a93f0b tempest-GroupSnapshotsTest-422176158 None] Update group completed successfully. Sep 21 16:37:27 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aac5880f-fc38-4419-916a-ff1729e54138" returned: 0 in 0.524s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aac5880f-fc38-4419-916a-ff1729e54138 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:27 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aac5880f-fc38-4419-916a-ff1729e54138 Sep 21 16:37:27 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:27 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aac5880f-fc38-4419-916a-ff1729e54138" returned: 0 in 0.339s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Lock "cinder-quobyte-aac5880f-fc38-4419-916a-ff1729e54138" released by "delete_volume" :: held 0.927s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:27 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Created reservations ['9ac1b6c0-a581-478c-ab0d-8fd6234559a3', '98ee70f0-51c3-43cb-a9e7-07c880af3945', '27c2a92d-7069-4ba7-aa27-34edf8b44e17', '4e46c9a7-906a-4ec6-826a-30af7687c527'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:27 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:37:27 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "cinder-64acdf9e-d8ac-44d4-9b2d-ba40f6135611-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Lock "cinder-64acdf9e-d8ac-44d4-9b2d-ba40f6135611-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "cinder-quobyte-64acdf9e-d8ac-44d4-9b2d-ba40f6135611" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:28 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.472s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:37:28 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Deleted volume successfully. Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Lock "cinder-quobyte-64acdf9e-d8ac-44d4-9b2d-ba40f6135611" acquired by "delete_volume" :: waited 0.034s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c8314b06-173b-4ab1-82b2-a9a3383fe053 tempest-AttachVolumeTestJSON-1403093250 None] Lock "cinder-aac5880f-fc38-4419-916a-ff1729e54138-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[146c6483-3132-43b0-a6b4-90b418906e43]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:28 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611 Sep 21 16:37:28 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:28 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:28 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] GroupSnapshot 2c35e87a-1098-4dd3-bb83-8fc042d879e1: creating. Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611" returned: 0 in 0.456s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:28 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611 Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Group snapshot 2c35e87a-1098-4dd3-bb83-8fc042d879e1: creating. {{(pid=86030) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 21 16:37:28 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Creating offline snapshot 9b2f74f7-4589-4aae-a84f-a7c188a20846 of volume df71f958-9a33-49f2-b067-c42e24fc2d4c {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e000edc-a792-443d-a503-718eb59181c0]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:28 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c Sep 21 16:37:28 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:28 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-64acdf9e-d8ac-44d4-9b2d-ba40f6135611" returned: 0 in 0.284s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Lock "cinder-quobyte-64acdf9e-d8ac-44d4-9b2d-ba40f6135611" released by "delete_volume" :: held 0.831s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:28 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Created reservations ['9d51ce60-a4a7-49da-a468-e0f57b840b81', '1f5d84eb-283c-4191-8103-6754f82ac8b8', 'da0381d4-1ffa-41ec-993a-2c0666a6e7cd', 'a14b58a7-3a0b-4baa-a109-42dc2cceaacb'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:29 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:37:29 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:29 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c" returned: 0 in 0.443s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:29 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 1G Sep 21 16:37:29 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:29 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.330s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:29 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:37:29 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Deleted volume successfully. Sep 21 16:37:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a63e1ce6-72ea-488f-8d74-a84155014189 tempest-AttachVolumeTestJSON-1403093250 None] Lock "cinder-64acdf9e-d8ac-44d4-9b2d-ba40f6135611-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:29 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 1G" returned: 0 in 0.575s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df71f958-9a33-49f2-b067-c42e24fc2d4c -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:29 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df71f958-9a33-49f2-b067-c42e24fc2d4c -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 Sep 21 16:37:29 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:29 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df71f958-9a33-49f2-b067-c42e24fc2d4c -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846" returned: 0 in 0.312s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:30 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:37:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:30 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 Sep 21 16:37:30 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:30 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846" returned: 0 in 0.265s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:30 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.info Sep 21 16:37:30 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:30 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.info" returned: 0 in 0.433s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:30 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:37:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:30 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.info Sep 21 16:37:30 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:31 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.info" returned: 0 in 0.290s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Creating offline snapshot b08fe0f0-2e25-472f-b1a0-d15829e5c71a of volume 8276a40d-f57c-4e82-ac08-93fe07e7f79d {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:37:31 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce55120-f88d-4e44-b446-586b97b02552]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:31 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d Sep 21 16:37:31 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:31 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d" returned: 0 in 0.462s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:31 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a 1G Sep 21 16:37:31 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:32 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a 1G" returned: 0 in 0.486s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:32 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a Sep 21 16:37:32 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:32 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a" returned: 0 in 0.353s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:32 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:37:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:32 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a Sep 21 16:37:32 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:32 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a" returned: 0 in 0.253s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:32 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.info Sep 21 16:37:32 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:32 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.info" returned: 0 in 0.296s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:32 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:37:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:33 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.info Sep 21 16:37:33 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:33 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.info" returned: 0 in 0.376s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-173e087c-0594-4a1d-b236-68e452abf36f tempest-GroupSnapshotsTest-422176158 None] group_snapshot 2c35e87a-1098-4dd3-bb83-8fc042d879e1: created successfully Sep 21 16:37:34 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] group_snapshot 2c35e87a-1098-4dd3-bb83-8fc042d879e1: deleting Sep 21 16:37:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] group_snapshot 2c35e87a-1098-4dd3-bb83-8fc042d879e1: deleting {{(pid=86030) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 21 16:37:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-df71f958-9a33-49f2-b067-c42e24fc2d4c" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-df71f958-9a33-49f2-b067-c42e24fc2d4c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-9b2f74f7-4589-4aae-a84f-a7c188a20846" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-9b2f74f7-4589-4aae-a84f-a7c188a20846" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Deleting offline snapshot 9b2f74f7-4589-4aae-a84f-a7c188a20846 of volume df71f958-9a33-49f2-b067-c42e24fc2d4c {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:37:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] snapshot_file for this snap is: volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:37:34 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1b2f12-d613-4f8f-b830-fae4f140dc35]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:34 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 Sep 21 16:37:34 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:34 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846" returned: 0 in 0.521s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df71f958-9a33-49f2-b067-c42e24fc2d4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:37:34 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6397b6-35b0-40f1-9466-dc5369aff12c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:34 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c Sep 21 16:37:34 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c" returned: 0 in 0.471s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:35 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:35 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 Sep 21 16:37:35 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:35 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846" returned: 0 in 0.500s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:35 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846 Sep 21 16:37:35 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:36 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c.9b2f74f7-4589-4aae-a84f-a7c188a20846" returned: 0 in 0.382s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-9b2f74f7-4589-4aae-a84f-a7c188a20846" released by "_delete_snapshot" :: held 2.018s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-df71f958-9a33-49f2-b067-c42e24fc2d4c" released by "delete_snapshot" :: held 2.052s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-8276a40d-f57c-4e82-ac08-93fe07e7f79d" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-8276a40d-f57c-4e82-ac08-93fe07e7f79d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-b08fe0f0-2e25-472f-b1a0-d15829e5c71a" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-b08fe0f0-2e25-472f-b1a0-d15829e5c71a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Deleting offline snapshot b08fe0f0-2e25-472f-b1a0-d15829e5c71a of volume 8276a40d-f57c-4e82-ac08-93fe07e7f79d {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] snapshot_file for this snap is: volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74beeba-d5b2-4732-b8a3-b7f598e33612]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:36 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a Sep 21 16:37:36 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:36 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a" returned: 0 in 0.504s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7d12b6-9596-496f-8838-8a17a64ad11a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:37 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d Sep 21 16:37:37 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:37 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d" returned: 0 in 0.463s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:37 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a Sep 21 16:37:37 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:37 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a" returned: 0 in 0.436s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:37 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a Sep 21 16:37:37 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:38 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d.b08fe0f0-2e25-472f-b1a0-d15829e5c71a" returned: 0 in 0.293s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-b08fe0f0-2e25-472f-b1a0-d15829e5c71a" released by "_delete_snapshot" :: held 1.864s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-8276a40d-f57c-4e82-ac08-93fe07e7f79d" released by "delete_snapshot" :: held 1.897s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:38 devstack cinder-volume[86030]: WARNING cinder.quota [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-520336840 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-520336840, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:37:38 devstack cinder-volume[86030]: WARNING cinder.quota [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-520336840 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-520336840, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:37:38 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Created reservations ['8f1f756e-4de1-4128-b44c-845cef390e4e', '5b762cf6-cd65-4267-b8eb-59f4d491e35e', '402bffa2-b49e-4029-bd34-67e274e7554c', 'd17209ac-7ef4-48af-8d7e-a1822d3fc475'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:38 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] Created reservations ['14557f8e-5766-45f9-a10d-4b5eed75d01d', '1bf43ec8-f5a8-4460-8ff2-6df19b4ee2a8', '20d876ab-7aeb-4e31-b83d-bc09396082be', 'b9971fdf-a1bd-433e-94e2-eae42a7fc864'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:38 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a3686387-df17-4e6b-816d-961e2dc6b080 tempest-GroupSnapshotsTest-422176158 None] group_snapshot 2c35e87a-1098-4dd3-bb83-8fc042d879e1: deleted successfully Sep 21 16:37:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-8276a40d-f57c-4e82-ac08-93fe07e7f79d" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-8276a40d-f57c-4e82-ac08-93fe07e7f79d" acquired by "delete_volume" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:39 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be8f613-fd34-4414-950e-a32c82ca0bf9]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:39 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-3ecad9fa-ee45-4141-b07b-39a20ba6f0ec req-38eaddea-9666-48c6-8a58-a799036e24e4 tempest-ServerActionsTestOtherA-1999102138 None] Terminate volume connection completed successfully. Sep 21 16:37:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-3ecad9fa-ee45-4141-b07b-39a20ba6f0ec req-38eaddea-9666-48c6-8a58-a799036e24e4 tempest-ServerActionsTestOtherA-1999102138 None] Deleting attachment 0faac98f-cad3-41ca-8033-c25406c2aa5b. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:37:39 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d Sep 21 16:37:39 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:39 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d" returned: 0 in 0.510s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:40 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d Sep 21 16:37:40 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:40 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8276a40d-f57c-4e82-ac08-93fe07e7f79d" returned: 0 in 0.325s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-8276a40d-f57c-4e82-ac08-93fe07e7f79d" released by "delete_volume" :: held 0.931s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-df71f958-9a33-49f2-b067-c42e24fc2d4c" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-df71f958-9a33-49f2-b067-c42e24fc2d4c" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:40 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b4d4dd-dfd8-4ef0-881a-aa312ecaba73]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:40 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c Sep 21 16:37:40 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:41 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c" returned: 0 in 0.714s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:41 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c Sep 21 16:37:41 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:41 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df71f958-9a33-49f2-b067-c42e24fc2d4c" returned: 0 in 0.374s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-df71f958-9a33-49f2-b067-c42e24fc2d4c" released by "delete_volume" :: held 1.175s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:41 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Created reservations ['aa3fd55f-f00e-4908-bd36-f9116d66c65c'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:41 devstack cinder-volume[86030]: WARNING cinder.quota [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-520336840 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-520336840, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:37:41 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Created reservations ['485cb484-75fc-4cba-bfc2-35ba58377728', '79657c0b-01cd-40de-99dd-42d8fa9ed60b', '08e1876a-756b-46b4-8c4a-1b62e7923cdd', '6a1339de-2f15-4d94-927f-f09b5dc6063d'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:41 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Created reservations ['8e1c9d19-395a-4902-8fc0-8ba2aab302d4', 'd2b9aa9a-ac3a-4de8-9a97-7155aeca2b78', 'f4f7d393-ca06-4e06-b624-3f1fd96190fd', '454de29e-9def-42be-8c13-175efea157de'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:42 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:37:42 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:42 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.321s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:42 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:37:42 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-84b7e521-48f6-498e-baf2-025c336def9e tempest-GroupSnapshotsTest-422176158 None] Delete group completed successfully. Sep 21 16:37:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5f7b952b-d741-4600-9b05-e4265c00f31c tempest-GroupSnapshotsTest-422176158 None] Group tempest-GroupSnapshotsTest-Group-1264724530: creating Sep 21 16:37:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5f7b952b-d741-4600-9b05-e4265c00f31c tempest-GroupSnapshotsTest-422176158 None] Group tempest-GroupSnapshotsTest-Group-1264724530: created successfully Sep 21 16:37:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5f7b952b-d741-4600-9b05-e4265c00f31c tempest-GroupSnapshotsTest-422176158 None] Create group completed successfully. Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=157,cinder:UPDATE=123,cinder:INSERT=26,cinder:DELETE=4 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=141,cinder:UPDATE=134,cinder:INSERT=30,cinder:DELETE=5 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Flow 'volume_create_manager' (ba6faa65-b5c4-43ee-bdf5-94432470a9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80d1435-d52d-42de-84c3-f194df48526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80d1435-d52d-42de-84c3-f194df48526c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1967450870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9be44b94-ea32-42e0-b231-6fb301f37d3e,host='devstack@QuobyteHD#QuobyteHD',id=9a32f744-3383-427a-89f6-1e4ea8f5c9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4796dc2b81904ee0a4f13adf2ac84c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:45Z,use_quota=True,user_id='3db6a5d636df4ac1b62f0a311730a49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aea0374e-bb55-4b5c-bb25-92c40c3ff599),volume_type_id=aea0374e-bb55-4b5c-bb25-92c40c3ff599)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcdb532-a298-497f-9971-466e92c99f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcdb532-a298-497f-9971-466e92c99f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1fda51-d725-48c4-baeb-df9fe1828bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1fda51-d725-48c4-baeb-df9fe1828bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a32f744-3383-427a-89f6-1e4ea8f5c9af', 'volume_name': 'volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5770ecdb-6106-4c08-8895-ff825001193d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5770ecdb-6106-4c08-8895-ff825001193d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1d602a-d956-42e9-aecc-a2a57a7d869b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:45 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Volume 9a32f744-3383-427a-89f6-1e4ea8f5c9af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af', 'volume_size': 1} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9be44b94-ea32-42e0-b231-6fb301f37d3e,created_at=2026-09-21T14:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1967450870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9be44b94-ea32-42e0-b231-6fb301f37d3e,host='devstack@QuobyteHD#QuobyteHD',id=9a32f744-3383-427a-89f6-1e4ea8f5c9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4796dc2b81904ee0a4f13adf2ac84c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:45Z,use_quota=True,user_id='3db6a5d636df4ac1b62f0a311730a49f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aea0374e-bb55-4b5c-bb25-92c40c3ff599),volume_type_id=aea0374e-bb55-4b5c-bb25-92c40c3ff599)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Creating volume 9a32f744-3383-427a-89f6-1e4ea8f5c9af {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:37:45 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:37:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:45 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af 1073741824 Sep 21 16:37:45 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:46 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af 1073741824" returned: 0 in 0.654s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:46 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af Sep 21 16:37:46 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:46 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af" returned: 0 in 0.491s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:37:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1d602a-d956-42e9-aecc-a2a57a7d869b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f069f9d-a96e-4420-ab4a-db089d3af6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:46 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Volume volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af (9a32f744-3383-427a-89f6-1e4ea8f5c9af): created successfully Sep 21 16:37:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f069f9d-a96e-4420-ab4a-db089d3af6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Flow 'volume_create_manager' (ba6faa65-b5c4-43ee-bdf5-94432470a9ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-feb1b51c-fe32-4604-b211-10af7c5a60f6 tempest-GroupSnapshotsTest-422176158 None] Created volume successfully. Sep 21 16:37:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] GroupSnapshot f34b7120-6aa4-40a1-93c2-6068aeaf49eb: creating. Sep 21 16:37:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] Group snapshot f34b7120-6aa4-40a1-93c2-6068aeaf49eb: creating. {{(pid=86030) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 21 16:37:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] Creating offline snapshot 4760b060-976d-4370-9593-06f1aeb75d85 of volume 9a32f744-3383-427a-89f6-1e4ea8f5c9af {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:37:48 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd17827-267f-4be5-b460-c492e498492f]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:48 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af Sep 21 16:37:48 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:49 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af" returned: 0 in 0.581s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:49 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 1G Sep 21 16:37:49 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:49 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 1G" returned: 0 in 0.664s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:49 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 Sep 21 16:37:49 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:50 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85" returned: 0 in 0.382s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:50 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:50 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 Sep 21 16:37:50 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:50 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85" returned: 0 in 0.396s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:50 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.info Sep 21 16:37:50 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Flow 'volume_create_manager' (d3c500ce-0119-4c15-a18e-44e1ff913586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504db338-f622-47ea-bb65-ad38555f3716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504db338-f622-47ea-bb65-ad38555f3716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-956772384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cf2a60-438e-4c29-ab76-3cc069dd1a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4baf7c1849664a04bfddadb877c9bb45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:50Z,use_quota=True,user_id='2fbc1f2e5f93446a8a3fb0ed3dd5d375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9c3fdf-0092-48b8-bfa3-e40da47b1106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9c3fdf-0092-48b8-bfa3-e40da47b1106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace1d458-4ec9-40c2-88b4-1c1ad6c0da61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG cinder.image.glance [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Creating Keystone auth plugin from conf {{(pid=86030) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 16:37:50 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.info" returned: 0 in 0.284s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:50 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.info is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:37:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:50 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.info Sep 21 16:37:50 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:51 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:51 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-86b8c8b5-31ae-4a00-99cb-52e773a0bba4 tempest-GroupSnapshotsV319Test-1443665785 None] Group tempest-GroupSnapshotsV319Test-Group-2115043780: creating Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.info" returned: 0 in 0.375s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.797s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:51 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-86b8c8b5-31ae-4a00-99cb-52e773a0bba4 tempest-GroupSnapshotsV319Test-1443665785 None] Group tempest-GroupSnapshotsV319Test-Group-2115043780: created successfully Sep 21 16:37:51 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-86b8c8b5-31ae-4a00-99cb-52e773a0bba4 tempest-GroupSnapshotsV319Test-1443665785 None] Create group completed successfully. Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace1d458-4ec9-40c2-88b4-1c1ad6c0da61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06cf2a60-438e-4c29-ab76-3cc069dd1a33', 'volume_name': 'volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1151b23b-3efa-4690-bb6a-7f9c4d8b0ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1151b23b-3efa-4690-bb6a-7f9c4d8b0ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d671964-2d74-4629-82a7-27d00f1559fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:51 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Volume 06cf2a60-438e-4c29-ab76-3cc069dd1a33: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Trying to clone 06cf2a60-438e-4c29-ab76-3cc069dd1a33 from image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]). {{(pid=86030) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 16:37:51 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-1e886505-0318-4b22-affb-9cf473d8a710 tempest-GroupSnapshotsTest-422176158 None] group_snapshot f34b7120-6aa4-40a1-93c2-6068aeaf49eb: created successfully Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 16:37:51 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Image download 20.69 MB at 20.69 MB/s Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda9059-a89b-4418-8cfd-4417c3d0cdd4]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:51 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] group_snapshot f34b7120-6aa4-40a1-93c2-6068aeaf49eb: deleting Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] group_snapshot f34b7120-6aa4-40a1-93c2-6068aeaf49eb: deleting {{(pid=86030) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-9a32f744-3383-427a-89f6-1e4ea8f5c9af" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-9a32f744-3383-427a-89f6-1e4ea8f5c9af" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-4760b060-976d-4370-9593-06f1aeb75d85" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:51 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD Sep 21 16:37:51 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-4760b060-976d-4370-9593-06f1aeb75d85" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Deleting offline snapshot 4760b060-976d-4370-9593-06f1aeb75d85 of volume 9a32f744-3383-427a-89f6-1e4ea8f5c9af {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] snapshot_file for this snap is: volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1dbfc6-3279-4e6f-a9ba-eb38bf62c42a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:52 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 Sep 21 16:37:52 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:52 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Temporary image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c is fetched for user 2fbc1f2e5f93446a8a3fb0ed3dd5d375. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fe8a6e-4b69-4276-b280-745fdb7ac4c2]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:52 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD Sep 21 16:37:52 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:52 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85" returned: 0 in 0.538s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec73b61a-766e-4327-826c-b2773ec51964]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:52 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-956772384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cf2a60-438e-4c29-ab76-3cc069dd1a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4baf7c1849664a04bfddadb877c9bb45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:50Z,use_quota=True,user_id='2fbc1f2e5f93446a8a3fb0ed3dd5d375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Creating volume 06cf2a60-438e-4c29-ab76-3cc069dd1a33 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:37:52 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:37:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:52 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af Sep 21 16:37:52 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:52 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 1073741824 Sep 21 16:37:52 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Flow 'volume_create_manager' (b8137c04-06db-4b58-be7d-a9b6f4943c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9901458-09d4-48e3-86c3-6abf74fc25e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9901458-09d4-48e3-86c3-6abf74fc25e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1969014078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=02ac7671-eaa4-45ee-8abd-8239c561ba0a,host='devstack@QuobyteHD#QuobyteHD',id=dd302a7c-54e5-462f-9636-9c6f1cca6586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3da093231704263acc018fcacc7be3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:53Z,use_quota=True,user_id='238a687cc3cf46628ef06aced1e52dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6b693a1-b1c3-452b-9e3c-f7b83c005e02),volume_type_id=a6b693a1-b1c3-452b-9e3c-f7b83c005e02)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:53 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e03bb2-f845-4c7d-9847-1f54309f4362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e03bb2-f845-4c7d-9847-1f54309f4362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fb22f8-bcc1-4b49-8c4c-53fd21b5bdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fb22f8-bcc1-4b49-8c4c-53fd21b5bdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd302a7c-54e5-462f-9636-9c6f1cca6586', 'volume_name': 'volume-dd302a7c-54e5-462f-9636-9c6f1cca6586', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408a5910-ffd5-4fe3-8daa-74408528fb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408a5910-ffd5-4fe3-8daa-74408528fb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bd302a-d083-4468-9813-ce23730cb1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:53 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Volume dd302a7c-54e5-462f-9636-9c6f1cca6586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd302a7c-54e5-462f-9636-9c6f1cca6586', 'volume_size': 1} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af" returned: 0 in 0.539s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:53 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 Sep 21 16:37:53 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:53 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 1073741824" returned: 0 in 0.575s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:53 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 Sep 21 16:37:53 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:53 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85" returned: 0 in 0.371s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:53 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85 Sep 21 16:37:53 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:53 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33" returned: 0 in 0.275s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=02ac7671-eaa4-45ee-8abd-8239c561ba0a,created_at=2026-09-21T14:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1969014078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=02ac7671-eaa4-45ee-8abd-8239c561ba0a,host='devstack@QuobyteHD#QuobyteHD',id=dd302a7c-54e5-462f-9636-9c6f1cca6586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3da093231704263acc018fcacc7be3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:37:53Z,use_quota=True,user_id='238a687cc3cf46628ef06aced1e52dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6b693a1-b1c3-452b-9e3c-f7b83c005e02),volume_type_id=a6b693a1-b1c3-452b-9e3c-f7b83c005e02)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Creating volume dd302a7c-54e5-462f-9636-9c6f1cca6586 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:37:53 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:53 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 1073741824 Sep 21 16:37:53 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Attempting download of 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}])) to volume 06cf2a60-438e-4c29-ab76-3cc069dd1a33. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34dc5ff-58dd-40e4-be9f-cac39e258416]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_osa5aoxz {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:53 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af.4760b060-976d-4370-9593-06f1aeb75d85" returned: 0 in 0.295s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-4760b060-976d-4370-9593-06f1aeb75d85" released by "_delete_snapshot" :: held 1.905s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-9a32f744-3383-427a-89f6-1e4ea8f5c9af" released by "delete_snapshot" :: held 1.940s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:53 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_osa5aoxz Sep 21 16:37:53 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:53 devstack cinder-volume[86030]: WARNING cinder.quota [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1740977667 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1740977667, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:37:53 devstack cinder-volume[86030]: WARNING cinder.quota [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1740977667 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1740977667, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:37:53 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] Created reservations ['e41c7947-c3bb-45c1-a928-8fa7fe55b9a5', 'de4afcb6-f3c2-4de0-be78-6c32541e6905', '7240eff7-110f-40f8-adb5-57aef01063bd', '3f8ebdd2-197d-4b24-804e-2c2289fb2407'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:54 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4f3f56a2-7117-49c7-939a-1e0e33da4aff tempest-GroupSnapshotsTest-422176158 None] group_snapshot f34b7120-6aa4-40a1-93c2-6068aeaf49eb: deleted successfully Sep 21 16:37:54 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_osa5aoxz" returned: 0 in 0.419s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_osa5aoxz {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:54 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 1073741824" returned: 0 in 0.633s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:54 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_osa5aoxz Sep 21 16:37:54 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:54 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 Sep 21 16:37:54 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "cinder-quobyte-9a32f744-3383-427a-89f6-1e4ea8f5c9af" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:54 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:54 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_osa5aoxz" returned: 1 in 0.454s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_osa5aoxz' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586" returned: 0 in 0.310s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e95c96-2c6f-46fb-806b-b40090a7e1a6]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-9a32f744-3383-427a-89f6-1e4ea8f5c9af" acquired by "delete_volume" :: waited 0.052s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bd302a-d083-4468-9813-ce23730cb1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd302a7c-54e5-462f-9636-9c6f1cca6586', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee20840-1ad6-4b9a-8004-245b4a0c662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b31e3b-bf0e-43ce-9916-7a42bb8b8101]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:54 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Volume volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 (dd302a7c-54e5-462f-9636-9c6f1cca6586): created successfully Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee20840-1ad6-4b9a-8004-245b4a0c662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Flow 'volume_create_manager' (b8137c04-06db-4b58-be7d-a9b6f4943c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:54 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD Sep 21 16:37:54 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:54 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-02adb993-645a-4e2a-bc13-f67b59c38e65 tempest-GroupSnapshotsV319Test-1443665785 None] Created volume successfully. Sep 21 16:37:54 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af Sep 21 16:37:54 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:55 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:55 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c was qcow2, converting to qcow2 {{(pid=86030) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 16:37:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:55 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 Sep 21 16:37:55 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:55 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af" returned: 0 in 0.452s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:55 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af Sep 21 16:37:55 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:55 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a32f744-3383-427a-89f6-1e4ea8f5c9af" returned: 0 in 0.308s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:55 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Lock "cinder-quobyte-9a32f744-3383-427a-89f6-1e4ea8f5c9af" released by "delete_volume" :: held 0.852s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:37:55 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Created reservations ['6231688b-0c9c-4b95-92d5-1862b4347964'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:55 devstack cinder-volume[86030]: WARNING cinder.quota [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1740977667 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1740977667, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:37:55 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Created reservations ['db00b405-48a1-4ea4-9de5-7bc93043daa9', '846b8019-0856-43b9-adeb-bbc63d4ae956', 'ca7a8251-e414-4eea-a601-eeec159c463b', '69946951-46ea-4170-854e-2e6af8f43f07'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:37:55 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] GroupSnapshot b6087bed-4823-4839-8804-05bf63c91a88: creating. Sep 21 16:37:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] Group snapshot b6087bed-4823-4839-8804-05bf63c91a88: creating. {{(pid=86030) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 21 16:37:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:37:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:37:56 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:37:56 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:37:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:56 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] Creating offline snapshot 127e0638-3681-43b6-95e5-0f4ab9b4e55b of volume dd302a7c-54e5-462f-9636-9c6f1cca6586 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:37:56 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:37:56 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:56 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0dfa88-331e-4fd0-98de-8e12990bb0d3]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:56 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 Sep 21 16:37:56 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:56 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.351s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:56 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:37:56 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0449b2fe-10b4-423c-9796-14f9d832b87d tempest-GroupSnapshotsTest-422176158 None] Delete group completed successfully. Sep 21 16:37:56 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586" returned: 0 in 0.514s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:56 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b 1G Sep 21 16:37:56 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:57 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b 1G" returned: 0 in 0.645s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:57 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b Sep 21 16:37:57 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:57 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b" returned: 0 in 0.541s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:57 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:37:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:57 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33" returned: 0 in 2.782s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:57 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_zhng5d5odevstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:37:57 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Converted 112.00 MB image at 40.24 MB/s Sep 21 16:37:57 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b Sep 21 16:37:57 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:57 devstack sudo[91419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 1G Sep 21 16:37:57 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:58 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b" returned: 0 in 0.361s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:58 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.info Sep 21 16:37:58 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:58 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 1G" returned: 0 in 0.421s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Downloaded image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}])) to volume 06cf2a60-438e-4c29-ab76-3cc069dd1a33 successfully. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Temporary image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c for user 2fbc1f2e5f93446a8a3fb0ed3dd5d375 is deleted. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Marking volume 06cf2a60-438e-4c29-ab76-3cc069dd1a33 as bootable. {{(pid=86030) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Copying metadata from image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c to 06cf2a60-438e-4c29-ab76-3cc069dd1a33. {{(pid=86030) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Creating volume glance metadata for volume 06cf2a60-438e-4c29-ab76-3cc069dd1a33 backed by image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86030) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d671964-2d74-4629-82a7-27d00f1559fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5d86ed-b154-4ccb-b5f7-a36cf4e22977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:37:58 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Volume volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 (06cf2a60-438e-4c29-ab76-3cc069dd1a33): created successfully Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5d86ed-b154-4ccb-b5f7-a36cf4e22977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Flow 'volume_create_manager' (d3c500ce-0119-4c15-a18e-44e1ff913586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:37:58 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-1cc5b3d3-1f64-4846-9ce6-6c7eeb44f735 tempest-ServerActionsTestOtherA-1999102138 None] Created volume successfully. Sep 21 16:37:58 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.info" returned: 0 in 0.337s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:58 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.info is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:58 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.info Sep 21 16:37:58 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:37:58 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.info" returned: 0 in 0.283s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:37:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.937s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:37:58 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-704daf8c-18b7-4771-be6b-13e3295b361d tempest-GroupSnapshotsV319Test-1443665785 None] group_snapshot b6087bed-4823-4839-8804-05bf63c91a88: created successfully Sep 21 16:37:59 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] group_snapshot b6087bed-4823-4839-8804-05bf63c91a88: deleting Sep 21 16:37:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] group_snapshot b6087bed-4823-4839-8804-05bf63c91a88: deleting {{(pid=86030) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 21 16:37:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Acquiring lock "cinder-quobyte-dd302a7c-54e5-462f-9636-9c6f1cca6586" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Lock "cinder-quobyte-dd302a7c-54e5-462f-9636-9c6f1cca6586" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Acquiring lock "cinder-quobyte-127e0638-3681-43b6-95e5-0f4ab9b4e55b" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:37:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Lock "cinder-quobyte-127e0638-3681-43b6-95e5-0f4ab9b4e55b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:37:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Deleting offline snapshot 127e0638-3681-43b6-95e5-0f4ab9b4e55b of volume dd302a7c-54e5-462f-9636-9c6f1cca6586 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:37:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] snapshot_file for this snap is: volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:37:59 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b08240-7ba1-48a1-94eb-a24daad27a2e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:37:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:37:59 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b Sep 21 16:37:59 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:00 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b" returned: 0 in 0.745s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd302a7c-54e5-462f-9636-9c6f1cca6586(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:00 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[d304eaef-c4ea-4b66-b540-a3193aa6959a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:00 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 Sep 21 16:38:00 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:01 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586" returned: 0 in 0.935s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:01 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b Sep 21 16:38:01 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:02 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b" returned: 0 in 0.625s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:02 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b Sep 21 16:38:02 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:02 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586.127e0638-3681-43b6-95e5-0f4ab9b4e55b" returned: 0 in 0.806s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Lock "cinder-quobyte-127e0638-3681-43b6-95e5-0f4ab9b4e55b" released by "_delete_snapshot" :: held 3.322s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Lock "cinder-quobyte-dd302a7c-54e5-462f-9636-9c6f1cca6586" released by "delete_snapshot" :: held 3.366s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:03 devstack cinder-volume[86030]: WARNING cinder.quota [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1351609039 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1351609039, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:38:03 devstack cinder-volume[86030]: WARNING cinder.quota [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1351609039 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1351609039, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:38:03 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] Created reservations ['711af272-3b7d-403c-a1ca-edf768332392', '01e9dd4d-fee4-4d0d-b2f1-e54c723e0447', '6b8b3751-122a-48f3-8fcf-52854362d511', 'cdcca22a-0c82-4fca-8dce-70bd65aa876e'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:38:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5fbfe20b-b0d2-4b94-b5f1-1b062156fad5 tempest-GroupSnapshotsV319Test-1443665785 None] group_snapshot b6087bed-4823-4839-8804-05bf63c91a88: deleted successfully Sep 21 16:38:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-15c5255b-05f5-4369-9392-0e653ec92968 req-e1a7fb05-52d6-4c23-8bc3-408a5521ea35 tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-15c5255b-05f5-4369-9392-0e653ec92968 req-e1a7fb05-52d6-4c23-8bc3-408a5521ea35 tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Acquiring lock "cinder-quobyte-dd302a7c-54e5-462f-9636-9c6f1cca6586" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-15c5255b-05f5-4369-9392-0e653ec92968 req-e1a7fb05-52d6-4c23-8bc3-408a5521ea35 tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Lock "cinder-quobyte-dd302a7c-54e5-462f-9636-9c6f1cca6586" acquired by "delete_volume" :: waited 0.042s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:04 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d05b305-ba60-4956-9b8e-8979e169bfe9]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-15c5255b-05f5-4369-9392-0e653ec92968 req-e1a7fb05-52d6-4c23-8bc3-408a5521ea35 tempest-ServerActionsTestOtherA-1999102138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5d38635-8afa-41a2-93f7-2df5d286cefe', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:38:05 devstack sudo[91567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 Sep 21 16:38:05 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:05 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-15c5255b-05f5-4369-9392-0e653ec92968 req-e1a7fb05-52d6-4c23-8bc3-408a5521ea35 tempest-ServerActionsTestOtherA-1999102138 None] attachment_update completed successfully. Sep 21 16:38:05 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586" returned: 0 in 0.989s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:05 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586 Sep 21 16:38:05 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:06 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dd302a7c-54e5-462f-9636-9c6f1cca6586" returned: 0 in 0.426s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Lock "cinder-quobyte-dd302a7c-54e5-462f-9636-9c6f1cca6586" released by "delete_volume" :: held 1.550s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:06 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Created reservations ['f8889243-eb13-4730-9080-ad647b88a7bb'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:38:06 devstack cinder-volume[86030]: WARNING cinder.quota [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1351609039 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1351609039, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:38:06 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Created reservations ['b7ae084d-2334-41d1-baf6-65bcb342034e', '56e73488-25ca-4dba-abe4-7674aaae346e', '5e093aaf-b6e3-4f74-83c9-6330942d0ab6', '46317f4b-a1c7-48ee-ab0d-3c5c81584b6d'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:38:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:38:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:38:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:06 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:38:06 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:07 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.489s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:07 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:38:07 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d9d038df-d282-4ff3-ade7-eecd07daad9e tempest-GroupSnapshotsV319Test-1443665785 None] Delete group completed successfully. Sep 21 16:38:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:38:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:38:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:38:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:07 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:38:07 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:08 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.630s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:38:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:38:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 28 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:38:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:38:16 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=65,cinder:UPDATE=53,cinder:INSERT=18 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:38:16 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=48,cinder:INSERT=18,cinder:DELETE=3,cinder:SELECT=61 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Flow 'volume_create_manager' (522cf918-4a0e-4acb-9c88-f887fe124120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fe5cb0-7196-4ef6-ae02-7035386f264d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fe5cb0-7196-4ef6-ae02-7035386f264d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1207900675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea13304-a014-4ec8-a782-6f68e6bbfccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f418dbbe4c5a4781af426b8820af9907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:38:20Z,use_quota=True,user_id='9c7afbf00c0b48d8a848b71ad2c3ccea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c33d03-712b-42f2-8cc5-7b134a7b4683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c33d03-712b-42f2-8cc5-7b134a7b4683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8ba9c6-997a-4af9-83eb-e7d83b8e4abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8ba9c6-997a-4af9-83eb-e7d83b8e4abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea13304-a014-4ec8-a782-6f68e6bbfccb', 'volume_name': 'volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6d3f27-9339-4e09-8cc5-2c9f237d2407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6d3f27-9339-4e09-8cc5-2c9f237d2407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9f336d-1852-425f-9da0-3ddb6a4d6f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:20 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Volume 7ea13304-a014-4ec8-a782-6f68e6bbfccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb', 'volume_size': 1} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1207900675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea13304-a014-4ec8-a782-6f68e6bbfccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f418dbbe4c5a4781af426b8820af9907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:38:20Z,use_quota=True,user_id='9c7afbf00c0b48d8a848b71ad2c3ccea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Creating volume 7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:38:20 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:20 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb 1073741824 Sep 21 16:38:20 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Flow 'volume_create_manager' (0efceaf0-dd26-4aca-a0c9-d30960487256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94c33be-0faa-4796-a4cc-345072f30ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94c33be-0faa-4796-a4cc-345072f30ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-903099974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f06a5390-0173-4f2f-8690-e15f3d9215b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1863a255b144e2daebeb6a19a75089c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:38:20Z,use_quota=True,user_id='dc4c1e9ddc224b06b2270f089b27b3e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422fdead-d108-4326-8856-d2a8a8311c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422fdead-d108-4326-8856-d2a8a8311c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f5ec6e-0034-4faa-a2dd-6c2c2188249a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f5ec6e-0034-4faa-a2dd-6c2c2188249a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f06a5390-0173-4f2f-8690-e15f3d9215b0', 'volume_name': 'volume-f06a5390-0173-4f2f-8690-e15f3d9215b0', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984ca825-f1b9-4e5d-ba18-a5605f03130e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984ca825-f1b9-4e5d-ba18-a5605f03130e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f9d195-3218-4b2e-bff5-4b70811c4bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:20 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Volume f06a5390-0173-4f2f-8690-e15f3d9215b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f06a5390-0173-4f2f-8690-e15f3d9215b0', 'volume_size': 1} Sep 21 16:38:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:21 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb 1073741824" returned: 0 in 0.563s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:21 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb Sep 21 16:38:21 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:21 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb" returned: 0 in 0.256s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.731s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-903099974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f06a5390-0173-4f2f-8690-e15f3d9215b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1863a255b144e2daebeb6a19a75089c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:38:20Z,use_quota=True,user_id='dc4c1e9ddc224b06b2270f089b27b3e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Creating volume f06a5390-0173-4f2f-8690-e15f3d9215b0 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:38:21 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f06a5390-0173-4f2f-8690-e15f3d9215b0 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9f336d-1852-425f-9da0-3ddb6a4d6f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176b0c2d-8426-4a53-894e-3cb98a8c53a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:21 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f06a5390-0173-4f2f-8690-e15f3d9215b0 1073741824 Sep 21 16:38:21 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:21 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Volume volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb (7ea13304-a014-4ec8-a782-6f68e6bbfccb): created successfully Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176b0c2d-8426-4a53-894e-3cb98a8c53a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Flow 'volume_create_manager' (522cf918-4a0e-4acb-9c88-f887fe124120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:38:21 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c99b2a0b-ca24-4895-9d7c-bff9decedc07 tempest-SnapshotsActionsTest-1806669411 None] Created volume successfully. Sep 21 16:38:22 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f06a5390-0173-4f2f-8690-e15f3d9215b0 1073741824" returned: 0 in 0.846s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f06a5390-0173-4f2f-8690-e15f3d9215b0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:22 devstack sudo[92111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f06a5390-0173-4f2f-8690-e15f3d9215b0 Sep 21 16:38:22 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:22 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f06a5390-0173-4f2f-8690-e15f3d9215b0" returned: 0 in 0.351s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.118s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] Creating offline snapshot c7c2a5a3-d542-40de-87a7-630198f32e2e of volume 7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f9d195-3218-4b2e-bff5-4b70811c4bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f06a5390-0173-4f2f-8690-e15f3d9215b0', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efa22ac-ba4c-433f-9715-a8b9c7f71fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9244bc03-0ad7-4cbb-b65c-50381352df2d]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:22 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Volume volume-f06a5390-0173-4f2f-8690-e15f3d9215b0 (f06a5390-0173-4f2f-8690-e15f3d9215b0): created successfully Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efa22ac-ba4c-433f-9715-a8b9c7f71fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Flow 'volume_create_manager' (0efceaf0-dd26-4aca-a0c9-d30960487256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:38:22 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-21b1e7ba-9b73-4e1c-bd10-055d011ab59a tempest-VolumeQuotasNegativeTestJSON-842785591 None] Created volume successfully. Sep 21 16:38:23 devstack sudo[92114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb Sep 21 16:38:23 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:23 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb" returned: 0 in 0.614s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:23 devstack sudo[92120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e 1G Sep 21 16:38:23 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:24 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e 1G" returned: 0 in 0.748s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:24 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-052777b2-a0b3-4ece-a63b-7c124cc3b2aa req-5227b736-0fc6-43f0-b583-e038a6231d19 tempest-ServerActionsTestOtherA-1999102138 None] Terminate volume connection completed successfully. Sep 21 16:38:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-052777b2-a0b3-4ece-a63b-7c124cc3b2aa req-5227b736-0fc6-43f0-b583-e038a6231d19 tempest-ServerActionsTestOtherA-1999102138 None] Deleting attachment b5d38635-8afa-41a2-93f7-2df5d286cefe. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:38:24 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e Sep 21 16:38:24 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:24 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e" returned: 0 in 0.553s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:24 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e is being set with open permissions: ugo+rw Sep 21 16:38:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:24 devstack sudo[92178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e Sep 21 16:38:24 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:25 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e" returned: 0 in 0.293s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:25 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.info Sep 21 16:38:25 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Acquiring lock "cinder-f06a5390-0173-4f2f-8690-e15f3d9215b0-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Lock "cinder-f06a5390-0173-4f2f-8690-e15f3d9215b0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Acquiring lock "cinder-quobyte-f06a5390-0173-4f2f-8690-e15f3d9215b0" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Lock "cinder-quobyte-f06a5390-0173-4f2f-8690-e15f3d9215b0" acquired by "delete_volume" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c13ce3-b6e2-41f8-8364-308088b055a2]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f06a5390-0173-4f2f-8690-e15f3d9215b0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:25 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.info" returned: 0 in 0.290s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:25 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.info is being set with open permissions: ugo+rw Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:25 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f06a5390-0173-4f2f-8690-e15f3d9215b0 Sep 21 16:38:25 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:25 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.info Sep 21 16:38:25 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:25 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:25 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.info" returned: 0 in 0.275s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.906s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f06a5390-0173-4f2f-8690-e15f3d9215b0" returned: 0 in 0.415s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f06a5390-0173-4f2f-8690-e15f3d9215b0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:25 devstack sudo[92193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f06a5390-0173-4f2f-8690-e15f3d9215b0 Sep 21 16:38:25 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:25 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-75270b3d-b825-4f7c-b8c2-184837a5f120 tempest-SnapshotsActionsTest-1806669411 None] Create snapshot completed successfully Sep 21 16:38:25 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f06a5390-0173-4f2f-8690-e15f3d9215b0" returned: 0 in 0.319s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Lock "cinder-quobyte-f06a5390-0173-4f2f-8690-e15f3d9215b0" released by "delete_volume" :: held 0.797s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Created reservations ['73fdc4dc-40fe-412a-a763-675a57b95eda', 'ad43fb1f-63ca-4198-bba5-98099cb8d0a6', '4db7099e-56c5-45c6-b525-2332a4705b96', '7ff5f8f1-e360-4561-902e-6e2f9bfd2241'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:26 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:38:26 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-052777b2-a0b3-4ece-a63b-7c124cc3b2aa req-b6869f05-3806-47b1-baad-3471312e595a tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-052777b2-a0b3-4ece-a63b-7c124cc3b2aa req-b6869f05-3806-47b1-baad-3471312e595a tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-052777b2-a0b3-4ece-a63b-7c124cc3b2aa req-b6869f05-3806-47b1-baad-3471312e595a tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-052777b2-a0b3-4ece-a63b-7c124cc3b2aa req-b6869f05-3806-47b1-baad-3471312e595a tempest-ServerActionsTestOtherA-1999102138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebd452c4-c8bc-4b9f-8aa6-4ce1af01a7e5', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:38:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-052777b2-a0b3-4ece-a63b-7c124cc3b2aa req-b6869f05-3806-47b1-baad-3471312e595a tempest-ServerActionsTestOtherA-1999102138 None] attachment_update completed successfully. Sep 21 16:38:26 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.302s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:38:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Deleted volume successfully. Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ac7be39e-a80a-43c3-bd4e-b0cddc76829e tempest-VolumeQuotasNegativeTestJSON-842785591 None] Lock "cinder-f06a5390-0173-4f2f-8690-e15f3d9215b0-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] Creating offline snapshot e3a86c2f-f36f-47d8-986c-a2480ff93275 of volume 7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d7ce94-d5fe-42e7-94c3-9e6630b65aed]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:26 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e Sep 21 16:38:26 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:27 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e" returned: 0 in 0.588s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:27 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 1G Sep 21 16:38:27 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:28 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 1G" returned: 0 in 0.707s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:28 devstack sudo[92668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 Sep 21 16:38:28 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:28 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275" returned: 0 in 0.429s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:28 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 is being set with open permissions: ugo+rw Sep 21 16:38:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:28 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 Sep 21 16:38:28 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:28 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275" returned: 0 in 0.355s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:29 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-14a7d648-ed1f-469b-a659-cb7213509288 tempest-SnapshotsActionsTest-1806669411 None] Create snapshot completed successfully Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Flow 'volume_create_manager' (85124fc4-4b7c-4995-acf6-cdaf12c6cfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6352c50a-5c0c-4fda-b0ca-9774f9a42846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6352c50a-5c0c-4fda-b0ca-9774f9a42846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1492845624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c739e90-7645-4a89-9c92-fdf13f743c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71df9ed60e8425bae2a7585ea3d6dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:38:29Z,use_quota=True,user_id='09b5152badbc40afbff6224872247168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4764ae11-6cb4-412e-a177-1347933fdd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4764ae11-6cb4-412e-a177-1347933fdd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1907dbf8-6bab-4b7f-9a37-aed6420c4291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1907dbf8-6bab-4b7f-9a37-aed6420c4291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c739e90-7645-4a89-9c92-fdf13f743c40', 'volume_name': 'volume-9c739e90-7645-4a89-9c92-fdf13f743c40', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54c8d38-95dd-4ff4-9ebd-754ac352418e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54c8d38-95dd-4ff4-9ebd-754ac352418e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e98329-ed85-4504-8064-df74b62a34f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:29 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Volume 9c739e90-7645-4a89-9c92-fdf13f743c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c739e90-7645-4a89-9c92-fdf13f743c40', 'volume_size': 1} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1492845624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c739e90-7645-4a89-9c92-fdf13f743c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71df9ed60e8425bae2a7585ea3d6dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:38:29Z,use_quota=True,user_id='09b5152badbc40afbff6224872247168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Creating volume 9c739e90-7645-4a89-9c92-fdf13f743c40 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:38:29 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:38:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9c739e90-7645-4a89-9c92-fdf13f743c40 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:29 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9c739e90-7645-4a89-9c92-fdf13f743c40 1073741824 Sep 21 16:38:29 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Acquiring lock "cinder-e3a86c2f-f36f-47d8-986c-a2480ff93275-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-e3a86c2f-f36f-47d8-986c-a2480ff93275-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Acquiring lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Acquiring lock "cinder-quobyte-e3a86c2f-f36f-47d8-986c-a2480ff93275" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-e3a86c2f-f36f-47d8-986c-a2480ff93275" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Deleting offline snapshot e3a86c2f-f36f-47d8-986c-a2480ff93275 of volume 7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:38:30 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] snapshot_file for this snap is: volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9c739e90-7645-4a89-9c92-fdf13f743c40 1073741824" returned: 0 in 0.799s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5dd87e-c08c-4bef-b6df-ef86acb50fed]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9c739e90-7645-4a89-9c92-fdf13f743c40 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:30 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9c739e90-7645-4a89-9c92-fdf13f743c40 Sep 21 16:38:30 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:30 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 Sep 21 16:38:30 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:30 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9c739e90-7645-4a89-9c92-fdf13f743c40" returned: 0 in 0.388s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e98329-ed85-4504-8064-df74b62a34f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c739e90-7645-4a89-9c92-fdf13f743c40', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddecdcb-374c-45be-8c9b-ed5c3932cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:30 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Volume volume-9c739e90-7645-4a89-9c92-fdf13f743c40 (9c739e90-7645-4a89-9c92-fdf13f743c40): created successfully Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddecdcb-374c-45be-8c9b-ed5c3932cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Flow 'volume_create_manager' (85124fc4-4b7c-4995-acf6-cdaf12c6cfad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:38:30 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3ac3ea18-8ce4-4a34-953d-e459ea034f6b tempest-AttachVolumeNegativeTest-1864958692 None] Created volume successfully. Sep 21 16:38:31 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275" returned: 0 in 0.672s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:31 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[176b119a-9e0d-43b5-aaff-9087ce8e343c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:31 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e Sep 21 16:38:31 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:32 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e" returned: 0 in 0.949s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:32 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 Sep 21 16:38:32 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:32 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275" returned: 0 in 0.776s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:32 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275 Sep 21 16:38:32 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:33 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.e3a86c2f-f36f-47d8-986c-a2480ff93275" returned: 0 in 0.364s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-e3a86c2f-f36f-47d8-986c-a2480ff93275" released by "_delete_snapshot" :: held 3.013s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" released by "delete_snapshot" :: held 3.071s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-45d2c473-f3ba-4727-83d3-c56b79d8222a req-2db6ea4a-2bfe-4296-bc74-9b9c7dbec2e4 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-45d2c473-f3ba-4727-83d3-c56b79d8222a req-2db6ea4a-2bfe-4296-bc74-9b9c7dbec2e4 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-45d2c473-f3ba-4727-83d3-c56b79d8222a req-2db6ea4a-2bfe-4296-bc74-9b9c7dbec2e4 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-45d2c473-f3ba-4727-83d3-c56b79d8222a req-2db6ea4a-2bfe-4296-bc74-9b9c7dbec2e4 tempest-AttachVolumeNegativeTest-1864958692 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-9c739e90-7645-4a89-9c92-fdf13f743c40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94d9d1a1-d71a-4ff7-90d5-d73094015f48', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:38:33 devstack cinder-volume[86030]: WARNING cinder.quota [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:38:33 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Created reservations ['93773284-6647-42c2-a6a7-52f1bd0ac09c', 'd0e62d3f-9f26-40cc-971a-f39db8433638', '503c35e3-2305-4711-bc7b-ea0d1144eddc', '3b2f3c14-8924-4dea-9dcd-826f5aeac3ce'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:38:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-45d2c473-f3ba-4727-83d3-c56b79d8222a req-2db6ea4a-2bfe-4296-bc74-9b9c7dbec2e4 tempest-AttachVolumeNegativeTest-1864958692 None] attachment_update completed successfully. Sep 21 16:38:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Delete snapshot completed successfully. Sep 21 16:38:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec8bcb10-624e-4039-b351-e10a7721e525 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-e3a86c2f-f36f-47d8-986c-a2480ff93275-delete_snapshot" released by "delete_snapshot" :: held 3.427s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] Creating offline snapshot 43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf of volume 7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:38:35 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ec66b5-aca9-4c5f-8fb5-ce1df07823e9]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:35 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e Sep 21 16:38:35 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:35 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e" returned: 0 in 0.668s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:36 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf 1G Sep 21 16:38:36 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:36 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf 1G" returned: 0 in 0.753s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:36 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf Sep 21 16:38:36 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:37 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf" returned: 0 in 0.404s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:37 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf is being set with open permissions: ugo+rw Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:37 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf Sep 21 16:38:37 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:37 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf" returned: 0 in 0.355s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Flow 'volume_create_manager' (367f767b-db55-4454-a6d2-6e4e1a0fa484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c885d0-8114-4877-b97e-244840808977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:37 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-2c9d8c5c-a9c7-4974-a2ad-d995147b1e83 tempest-SnapshotsActionsTest-1806669411 None] Create snapshot completed successfully Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c885d0-8114-4877-b97e-244840808977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-709337691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee61cf1-4ba2-413e-8e11-036be06f366a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a580f50c2a994486a1e0feafe6cb669b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:38:37Z,use_quota=True,user_id='af4dee00f074442cb313d08258c8970d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f10164-f3e8-474d-a111-c4674db0b72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f10164-f3e8-474d-a111-c4674db0b72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563e0c4b-698a-46a8-bde8-87400851f06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563e0c4b-698a-46a8-bde8-87400851f06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ee61cf1-4ba2-413e-8e11-036be06f366a', 'volume_name': 'volume-3ee61cf1-4ba2-413e-8e11-036be06f366a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24155b5-977f-464b-9abb-26a93c6b76b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24155b5-977f-464b-9abb-26a93c6b76b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e44ff3-b9cb-4787-bbac-c1f9252174d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:37 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Volume 3ee61cf1-4ba2-413e-8e11-036be06f366a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ee61cf1-4ba2-413e-8e11-036be06f366a', 'volume_size': 1} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-709337691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee61cf1-4ba2-413e-8e11-036be06f366a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a580f50c2a994486a1e0feafe6cb669b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:38:37Z,use_quota=True,user_id='af4dee00f074442cb313d08258c8970d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Creating volume 3ee61cf1-4ba2-413e-8e11-036be06f366a {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:38:37 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:38:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ee61cf1-4ba2-413e-8e11-036be06f366a 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:37 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ee61cf1-4ba2-413e-8e11-036be06f366a 1073741824 Sep 21 16:38:37 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:38 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ee61cf1-4ba2-413e-8e11-036be06f366a 1073741824" returned: 0 in 0.527s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ee61cf1-4ba2-413e-8e11-036be06f366a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:38 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ee61cf1-4ba2-413e-8e11-036be06f366a Sep 21 16:38:38 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:38 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ee61cf1-4ba2-413e-8e11-036be06f366a" returned: 0 in 0.338s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e44ff3-b9cb-4787-bbac-c1f9252174d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ee61cf1-4ba2-413e-8e11-036be06f366a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fafa6e-9400-4251-a8a2-c55c524d0173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:38:38 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Volume volume-3ee61cf1-4ba2-413e-8e11-036be06f366a (3ee61cf1-4ba2-413e-8e11-036be06f366a): created successfully Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fafa6e-9400-4251-a8a2-c55c524d0173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Flow 'volume_create_manager' (367f767b-db55-4454-a6d2-6e4e1a0fa484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Acquiring lock "cinder-43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:38 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-f8a8e7f9-1b47-43a9-bd8a-3ca8ed0ed958 tempest-VolumesServicesTestJSON-1319237408 None] Created volume successfully. Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Acquiring lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Acquiring lock "cinder-quobyte-43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Deleting offline snapshot 43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf of volume 7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] snapshot_file for this snap is: volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3741eb6-ec14-4dcc-87e4-561496257986]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:38 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf Sep 21 16:38:38 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:39 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf" returned: 0 in 0.416s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:39 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76de31f-30da-4add-9458-f00cac6b06d1]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:39 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e Sep 21 16:38:39 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:39 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e" returned: 0 in 0.480s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:39 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf Sep 21 16:38:39 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Acquiring lock "cinder-3ee61cf1-4ba2-413e-8e11-036be06f366a-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Lock "cinder-3ee61cf1-4ba2-413e-8e11-036be06f366a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Acquiring lock "cinder-quobyte-3ee61cf1-4ba2-413e-8e11-036be06f366a" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Lock "cinder-quobyte-3ee61cf1-4ba2-413e-8e11-036be06f366a" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:40 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fcbd20-3046-4699-8045-e872b98e4569]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ee61cf1-4ba2-413e-8e11-036be06f366a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:40 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ee61cf1-4ba2-413e-8e11-036be06f366a Sep 21 16:38:40 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:40 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf" returned: 0 in 0.578s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:40 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf Sep 21 16:38:40 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:40 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ee61cf1-4ba2-413e-8e11-036be06f366a" returned: 0 in 0.519s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ee61cf1-4ba2-413e-8e11-036be06f366a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:40 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ee61cf1-4ba2-413e-8e11-036be06f366a Sep 21 16:38:40 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:40 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf" returned: 0 in 0.434s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf" released by "_delete_snapshot" :: held 2.052s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" released by "delete_snapshot" :: held 2.087s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:40 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ee61cf1-4ba2-413e-8e11-036be06f366a" returned: 0 in 0.412s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Lock "cinder-quobyte-3ee61cf1-4ba2-413e-8e11-036be06f366a" released by "delete_volume" :: held 0.993s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:41 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Created reservations ['8ba1a0cb-d921-4e9d-ba5d-062ad3260119', '1592616e-d8c9-4910-ae68-dd3538764b2f', '98382634-48dc-4958-be34-a39a7419354b', '8715b34e-00d8-4088-bc93-fba30380ada7'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:38:41 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Delete snapshot completed successfully. Sep 21 16:38:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-357543e3-b864-473b-bc51-530674d72545 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-43cd2f94-0c0c-43a0-8e9c-d3ab8e9b0ccf-delete_snapshot" released by "delete_snapshot" :: held 2.356s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:41 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Created reservations ['1e0ea0df-345f-4113-8ab7-a3aacb4c081f', 'e83dcf2e-7a37-4778-8528-39a94b7cc97a', '93e11ee1-fb72-482f-891f-1d3211de74a2', '1202b286-f5a5-4967-a38e-9c7f23a6453a'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:38:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:38:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:38:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:41 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:38:41 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:41 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.366s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:41 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:38:41 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Deleted volume successfully. Sep 21 16:38:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-97165575-d8f2-4326-b56a-318df9708d58 tempest-VolumesServicesTestJSON-1319237408 None] Lock "cinder-3ee61cf1-4ba2-413e-8e11-036be06f366a-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] Creating offline snapshot c0a6a5ae-0a04-495a-94c3-21976959d0a6 of volume 7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:38:42 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[f860de67-db6a-4ecc-b3ab-cb504ff44c8b]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:43 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e Sep 21 16:38:43 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:43 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e" returned: 0 in 0.736s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:43 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 1G Sep 21 16:38:43 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:44 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 1G" returned: 0 in 0.669s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:44 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 Sep 21 16:38:44 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:44 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6" returned: 0 in 0.528s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:44 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 is being set with open permissions: ugo+rw Sep 21 16:38:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:44 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 Sep 21 16:38:44 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:45 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6" returned: 0 in 0.390s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:45 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-78ca1e54-2e33-4a84-ad59-c8081f78e682 tempest-SnapshotsActionsTest-1806669411 None] Create snapshot completed successfully Sep 21 16:38:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Acquiring lock "cinder-c0a6a5ae-0a04-495a-94c3-21976959d0a6-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-c0a6a5ae-0a04-495a-94c3-21976959d0a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Acquiring lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Acquiring lock "cinder-quobyte-c0a6a5ae-0a04-495a-94c3-21976959d0a6" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-c0a6a5ae-0a04-495a-94c3-21976959d0a6" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Deleting offline snapshot c0a6a5ae-0a04-495a-94c3-21976959d0a6 of volume 7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:38:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] snapshot_file for this snap is: volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:38:46 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[299219f1-4ad9-4c4c-bf42-7b99b2dbc6a8]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:46 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 Sep 21 16:38:46 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:47 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6" returned: 0 in 0.765s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:47 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb6ce48-5d2d-44bd-a9b9-49c92434c402]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:47 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e Sep 21 16:38:47 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:47 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e" returned: 0 in 0.637s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:47 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 Sep 21 16:38:47 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:48 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6" returned: 0 in 0.797s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:48 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6 Sep 21 16:38:48 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:48 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c0a6a5ae-0a04-495a-94c3-21976959d0a6" returned: 0 in 0.393s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-c0a6a5ae-0a04-495a-94c3-21976959d0a6" released by "_delete_snapshot" :: held 2.781s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" released by "delete_snapshot" :: held 2.831s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:49 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Created reservations ['d7487f21-dbaa-42bd-b00b-17c8365a8b93', '6e828ebf-eabc-40d5-a603-2fb29f79c191', '21eb1084-a5fb-4209-a0ff-b33fb546d00c', 'e66edb02-9105-4724-894b-5e172719d8fc'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:38:49 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Delete snapshot completed successfully. Sep 21 16:38:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6034c3c4-cb5e-40dd-baed-7c4b74bcd26b tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-c0a6a5ae-0a04-495a-94c3-21976959d0a6-delete_snapshot" released by "delete_snapshot" :: held 3.045s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:38:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:38:50 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] Creating offline snapshot 8d316151-6ebd-4861-b260-bb681872a76a of volume 7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:38:50 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4c3ea8-efd1-4b2d-8822-40bf80133c65]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:50 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e Sep 21 16:38:50 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:50 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e" returned: 0 in 0.638s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:50 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:50 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a 1G Sep 21 16:38:50 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:51 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a 1G" returned: 0 in 0.712s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:51 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a Sep 21 16:38:51 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:51 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a" returned: 0 in 0.398s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:51 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a is being set with open permissions: ugo+rw Sep 21 16:38:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:51 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a Sep 21 16:38:51 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:52 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a" returned: 0 in 0.330s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:38:52 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-18785cfc-aba9-428f-a82b-1177825c1ef0 tempest-SnapshotsActionsTest-1806669411 None] Create snapshot completed successfully Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Acquiring lock "cinder-8d316151-6ebd-4861-b260-bb681872a76a-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-8d316151-6ebd-4861-b260-bb681872a76a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Acquiring lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Acquiring lock "cinder-quobyte-8d316151-6ebd-4861-b260-bb681872a76a" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-8d316151-6ebd-4861-b260-bb681872a76a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Deleting offline snapshot 8d316151-6ebd-4861-b260-bb681872a76a of volume 7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] snapshot_file for this snap is: volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bea62c9-7a4a-456d-a50b-c681599a3683]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:53 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a Sep 21 16:38:53 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:53 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a" returned: 0 in 0.472s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[af267b9d-03d2-4cb8-b77c-db7d38a215dd]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:54 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e Sep 21 16:38:54 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:54 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e" returned: 0 in 0.501s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:54 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a Sep 21 16:38:54 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:55 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a" returned: 0 in 0.622s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:55 devstack sudo[93004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a Sep 21 16:38:55 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:55 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.8d316151-6ebd-4861-b260-bb681872a76a" returned: 0 in 0.416s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:55 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-8d316151-6ebd-4861-b260-bb681872a76a" released by "_delete_snapshot" :: held 2.147s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:55 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" released by "delete_snapshot" :: held 2.172s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:55 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Created reservations ['3db74953-0f90-43f3-a397-011544d17e23', '41026093-2034-496a-9dc6-39d420f883df', '587e63d2-6378-4e95-82ef-9d10386fc372', 'dcb445e2-5a6d-447d-baf8-45318194f1e0'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:38:55 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Delete snapshot completed successfully. Sep 21 16:38:55 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2157888e-9b55-44a6-9b31-0f4ae5094725 tempest-SnapshotsActionsTest-1054276833 None] Lock "cinder-8d316151-6ebd-4861-b260-bb681872a76a-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:38:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Acquiring lock "cinder-c7c2a5a3-d542-40de-87a7-630198f32e2e-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Lock "cinder-c7c2a5a3-d542-40de-87a7-630198f32e2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Acquiring lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Acquiring lock "cinder-quobyte-c7c2a5a3-d542-40de-87a7-630198f32e2e" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:38:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Lock "cinder-quobyte-c7c2a5a3-d542-40de-87a7-630198f32e2e" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:38:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Deleting offline snapshot c7c2a5a3-d542-40de-87a7-630198f32e2e of volume 7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:38:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] snapshot_file for this snap is: volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:38:57 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[08631795-aee2-42dd-a27c-15ec256fcdf0]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:57 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e Sep 21 16:38:57 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:58 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e" returned: 0 in 0.783s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:38:58 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c283fda-d064-4a71-b68a-1111df1e4f3e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:38:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:58 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb Sep 21 16:38:58 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:58 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb" returned: 0 in 0.714s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:58 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e Sep 21 16:38:58 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:38:59 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Sep 21 16:38:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e" returned: 0 in 0.616s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:38:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:38:59 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e Sep 21 16:38:59 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:00 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb.c7c2a5a3-d542-40de-87a7-630198f32e2e" returned: 0 in 0.562s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Lock "cinder-quobyte-c7c2a5a3-d542-40de-87a7-630198f32e2e" released by "_delete_snapshot" :: held 2.886s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" released by "delete_snapshot" :: held 2.936s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:00 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-51387907-5abf-41ea-98ad-f6db0698f965 req-3d76b429-a386-41ed-a37a-d3c4815abeec tempest-ServerActionsTestOtherA-1999102138 None] Terminate volume connection completed successfully. Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-51387907-5abf-41ea-98ad-f6db0698f965 req-3d76b429-a386-41ed-a37a-d3c4815abeec tempest-ServerActionsTestOtherA-1999102138 None] Deleting attachment ebd452c4-c8bc-4b9f-8aa6-4ce1af01a7e5. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Created reservations ['20e0feef-1e9e-4f91-9ea5-84857144ec80', '5160b681-e5de-43c3-a42c-aaecc00f676d', '6e6d0767-ab12-4513-a69e-9c15bd6a1d2f', '1b9ab68f-f815-4dcc-b4c6-efdc5a99d096'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:39:00 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Delete snapshot completed successfully. Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-92a80e1b-f24a-47c1-a343-880de5ac35af tempest-SnapshotsActionsTest-1806669411 None] Lock "cinder-c7c2a5a3-d542-40de-87a7-630198f32e2e-delete_snapshot" released by "delete_snapshot" :: held 3.177s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "cinder-06cf2a60-438e-4c29-ab76-3cc069dd1a33-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Lock "cinder-06cf2a60-438e-4c29-ab76-3cc069dd1a33-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "cinder-quobyte-06cf2a60-438e-4c29-ab76-3cc069dd1a33" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Lock "cinder-quobyte-06cf2a60-438e-4c29-ab76-3cc069dd1a33" acquired by "delete_volume" :: waited 0.039s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Acquiring lock "cinder-7ea13304-a014-4ec8-a782-6f68e6bbfccb-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e13c7d-812f-42f7-869c-56810f4f540d]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Lock "cinder-7ea13304-a014-4ec8-a782-6f68e6bbfccb-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:00 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 Sep 21 16:39:00 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Acquiring lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" acquired by "delete_volume" :: waited 0.049s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[829a99a2-228a-4924-9233-62d5f021dd92]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:01 devstack sudo[93097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb Sep 21 16:39:01 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:01 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33" returned: 0 in 0.690s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:01 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33 Sep 21 16:39:01 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:01 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb" returned: 0 in 0.505s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:01 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb Sep 21 16:39:01 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:01 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-06cf2a60-438e-4c29-ab76-3cc069dd1a33" returned: 0 in 0.329s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Lock "cinder-quobyte-06cf2a60-438e-4c29-ab76-3cc069dd1a33" released by "delete_volume" :: held 1.148s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG cinder.quota [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Created reservations ['c6db7a36-0afa-43bf-9b62-1e9090c8119e', 'e38ec51c-17f4-4c51-9b60-2699f98f9e05', '4179dc1b-d9b4-4fb7-a9e6-79b4d33ac942', 'cf653191-7bbd-49a1-9adf-f16242686bc3'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "cinder-42373e0f-9f2d-4bac-8b55-957779cfa8d6-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Lock "cinder-42373e0f-9f2d-4bac-8b55-957779cfa8d6-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:02 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:39:02 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:02 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7ea13304-a014-4ec8-a782-6f68e6bbfccb" returned: 0 in 0.440s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "cinder-quobyte-42373e0f-9f2d-4bac-8b55-957779cfa8d6" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Lock "cinder-quobyte-7ea13304-a014-4ec8-a782-6f68e6bbfccb" released by "delete_volume" :: held 1.106s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Lock "cinder-quobyte-42373e0f-9f2d-4bac-8b55-957779cfa8d6" acquired by "delete_volume" :: waited 0.037s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43e66d4-5665-41ce-8c57-c6bcd22125af]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Created reservations ['eb3b8de4-f8a7-4718-8442-420916d92007', '3796497e-aa83-43c3-a448-4b0f5a9137d2', 'cb1e07a5-58e8-4136-bc5f-6b1265f55853', 'fae4095d-fd58-4e6b-9c63-dec7c27e43ac'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:39:02 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.333s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG cinder.manager [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:39:02 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6 Sep 21 16:39:02 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:02 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Deleted volume successfully. Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-51387907-5abf-41ea-98ad-f6db0698f965 req-b7edbe90-aa0d-47fb-8523-82cb0aed4c82 tempest-ServerActionsTestOtherA-1999102138 None] Lock "cinder-06cf2a60-438e-4c29-ab76-3cc069dd1a33-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:02 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:39:02 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:02 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6" returned: 0 in 0.431s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:02 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.283s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:39:02 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Deleted volume successfully. Sep 21 16:39:02 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6 Sep 21 16:39:02 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-feca83f4-a679-46ed-a54d-fc5540da862b tempest-SnapshotsActionsTest-1806669411 None] Lock "cinder-7ea13304-a014-4ec8-a782-6f68e6bbfccb-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:02 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42373e0f-9f2d-4bac-8b55-957779cfa8d6" returned: 0 in 0.286s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Lock "cinder-quobyte-42373e0f-9f2d-4bac-8b55-957779cfa8d6" released by "delete_volume" :: held 0.769s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:02 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Created reservations ['17445f71-c737-48d6-b7d7-25d7397b7af7', '515d874f-bd92-42a8-922e-e1fc05708775', '2213312d-19a3-4e3a-b76d-59d3924dd786', '5dbc14c7-185c-455f-b342-b3625e38156c'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:39:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:03 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:39:03 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:03 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.469s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:03 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:39:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Deleted volume successfully. Sep 21 16:39:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-94319e64-43c4-48df-9be3-6323600bfc2a tempest-ServerActionsTestOtherA-1999102138 None] Lock "cinder-42373e0f-9f2d-4bac-8b55-957779cfa8d6-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:39:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:07 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:39:07 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:08 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.399s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:39:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:39:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 28 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:39:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Flow 'volume_create_manager' (8b52bc74-6acd-42a6-bf02-7e7f6c686614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb23892f-9698-4c26-985c-7aac5bcdcead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb23892f-9698-4c26-985c-7aac5bcdcead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-400153440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee9aa70-1f99-48a3-905d-3b1459c5d99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725bf6f1d68141cab6d1bb77bc2bdc89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:39:10Z,use_quota=True,user_id='041fb3d043fd4e3fa90219baea0f19ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0a1c73-948c-4bb2-a53b-433ee0868b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0a1c73-948c-4bb2-a53b-433ee0868b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be6dd62-7268-4e55-834a-618d6fee9d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be6dd62-7268-4e55-834a-618d6fee9d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ee9aa70-1f99-48a3-905d-3b1459c5d99c', 'volume_name': 'volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc10a0c-3ac2-4d87-a3a6-5235cdd9282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc10a0c-3ac2-4d87-a3a6-5235cdd9282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e151aa-fecd-4d3f-8cb7-7014f1d36ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:09 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Volume 0ee9aa70-1f99-48a3-905d-3b1459c5d99c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c', 'volume_size': 1} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-400153440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee9aa70-1f99-48a3-905d-3b1459c5d99c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725bf6f1d68141cab6d1bb77bc2bdc89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:39:10Z,use_quota=True,user_id='041fb3d043fd4e3fa90219baea0f19ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Creating volume 0ee9aa70-1f99-48a3-905d-3b1459c5d99c {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:39:09 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:39:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:09 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c 1073741824 Sep 21 16:39:09 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:10 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c 1073741824" returned: 0 in 0.491s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:10 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c Sep 21 16:39:10 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:10 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c" returned: 0 in 0.309s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:39:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e151aa-fecd-4d3f-8cb7-7014f1d36ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f05489d-7440-4b16-972d-501bc87f1a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:10 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Volume volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c (0ee9aa70-1f99-48a3-905d-3b1459c5d99c): created successfully Sep 21 16:39:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f05489d-7440-4b16-972d-501bc87f1a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Flow 'volume_create_manager' (8b52bc74-6acd-42a6-bf02-7e7f6c686614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:39:10 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-752a68a7-bc77-4158-9776-4e0ebbb8a334 tempest-VolumesTransfersV355Test-1205889109 None] Created volume successfully. Sep 21 16:39:11 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:39:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Flow 'volume_create_manager' (a1b5ea68-509e-4a9c-b7e4-a969f37ed0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:39:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b0c000-ef89-4b56-9dd9-2ba3caa5cf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b0c000-ef89-4b56-9dd9-2ba3caa5cf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1913002306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291a8c33a7ff44efb3676dad0fe77694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:39:12Z,use_quota=True,user_id='236ee74aae674cd5ab44a09d864e0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1d99ac-9f7d-4c38-abdb-04a326806d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1d99ac-9f7d-4c38-abdb-04a326806d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c54bb1-256d-4a57-9a0a-20c06af04d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c54bb1-256d-4a57-9a0a-20c06af04d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b', 'volume_name': 'volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0743ac8b-bd7f-4ebe-a59b-14de96f6852f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0743ac8b-bd7f-4ebe-a59b-14de96f6852f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f24f7e6-e312-485f-b027-3f8ccf75f5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:12 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Volume a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b', 'volume_size': 1} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1913002306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291a8c33a7ff44efb3676dad0fe77694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:39:12Z,use_quota=True,user_id='236ee74aae674cd5ab44a09d864e0640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Creating volume a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:39:12 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:12 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b 1073741824 Sep 21 16:39:12 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:12 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b 1073741824" returned: 0 in 0.692s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:12 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b Sep 21 16:39:12 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:13 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b" returned: 0 in 0.395s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:39:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f24f7e6-e312-485f-b027-3f8ccf75f5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c4c40d-a615-490f-8445-7799b4f6f259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:13 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Volume volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b (a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b): created successfully Sep 21 16:39:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c4c40d-a615-490f-8445-7799b4f6f259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Flow 'volume_create_manager' (a1b5ea68-509e-4a9c-b7e4-a969f37ed0a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:39:13 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-7fc9d92e-30cb-4dff-95e8-13c4196a5388 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Created volume successfully. Sep 21 16:39:13 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c54e4e68-f871-44fd-b90d-8a35d1f3eb71 tempest-VolumesTransfersV355Test-1223182232 None] Transfer volume completed successfully. Sep 21 16:39:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Creating offline snapshot c40b2954-6c0f-47f9-a733-cd78362df639 of volume a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:39:14 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4343a186-477e-4759-a952-5ea0dd399a1e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Acquiring lock "cinder-0ee9aa70-1f99-48a3-905d-3b1459c5d99c-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Lock "cinder-0ee9aa70-1f99-48a3-905d-3b1459c5d99c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:14 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b Sep 21 16:39:14 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Acquiring lock "cinder-quobyte-0ee9aa70-1f99-48a3-905d-3b1459c5d99c" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Lock "cinder-quobyte-0ee9aa70-1f99-48a3-905d-3b1459c5d99c" acquired by "delete_volume" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:14 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f637c8-ce84-4454-8725-7e163bd7bf06]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:14 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c Sep 21 16:39:14 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:14 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b" returned: 0 in 0.574s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:14 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 1G Sep 21 16:39:14 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:15 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c" returned: 0 in 0.494s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:15 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c Sep 21 16:39:15 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:15 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0ee9aa70-1f99-48a3-905d-3b1459c5d99c" returned: 0 in 0.373s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Lock "cinder-quobyte-0ee9aa70-1f99-48a3-905d-3b1459c5d99c" released by "delete_volume" :: held 0.946s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Created reservations ['ab811077-6c61-4c96-b52e-fa0b5d514b36', '914b6150-267f-47fd-a9cd-ef91dcf68060', '26d679d5-15c6-49e6-9647-d982a2d08d83', '43f151c3-b5e4-4b6d-8317-32fe5ced2fda'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:39:15 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 1G" returned: 0 in 0.704s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:15 devstack sudo[93272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 Sep 21 16:39:15 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:15 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:39:15 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:15 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.325s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:39:15 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Deleted volume successfully. Sep 21 16:39:15 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639" returned: 0 in 0.426s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:15 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 is being set with open permissions: ugo+rw Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-15497562-9b8c-44ac-b310-77166102ff50 tempest-VolumesTransfersV355Test-368023564 None] Lock "cinder-0ee9aa70-1f99-48a3-905d-3b1459c5d99c-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:16 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 Sep 21 16:39:16 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:16 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639" returned: 0 in 0.334s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:16 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.info Sep 21 16:39:16 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Flow 'volume_create_manager' (b8ba53cb-9ebc-4420-b735-ea142d228218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3f8529-e371-4d1b-9ace-200bb25b73b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3f8529-e371-4d1b-9ace-200bb25b73b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1459567117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05fbfba4-ab47-421a-94b2-ed16f4ebbff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725bf6f1d68141cab6d1bb77bc2bdc89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:39:17Z,use_quota=True,user_id='041fb3d043fd4e3fa90219baea0f19ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc37387-f7f6-4e19-9d69-634371c388fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc37387-f7f6-4e19-9d69-634371c388fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f794b2f0-f5fa-4138-8a66-2cb523ba0efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f794b2f0-f5fa-4138-8a66-2cb523ba0efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05fbfba4-ab47-421a-94b2-ed16f4ebbff1', 'volume_name': 'volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e28b7e-bc98-4976-8aa7-d4d654af8d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e28b7e-bc98-4976-8aa7-d4d654af8d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083ea77e-f677-412b-91e4-2b807ab46672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:16 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Volume 05fbfba4-ab47-421a-94b2-ed16f4ebbff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1', 'volume_size': 1} Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:16 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.info" returned: 0 in 0.410s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:16 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.info is being set with open permissions: ugo+rw Sep 21 16:39:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:16 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.info Sep 21 16:39:16 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:17 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.info" returned: 0 in 0.274s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.846s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1459567117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05fbfba4-ab47-421a-94b2-ed16f4ebbff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='725bf6f1d68141cab6d1bb77bc2bdc89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:39:17Z,use_quota=True,user_id='041fb3d043fd4e3fa90219baea0f19ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Creating volume 05fbfba4-ab47-421a-94b2-ed16f4ebbff1 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:39:17 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=102,cinder:UPDATE=101,cinder:DELETE=10,cinder:INSERT=24 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:39:17 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1 1073741824 Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=108,cinder:SELECT=97,cinder:INSERT=28,cinder:DELETE=7 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:39:17 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:17 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a7774988-e585-49e7-8dff-c357800c2100 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Create snapshot completed successfully Sep 21 16:39:17 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1 1073741824" returned: 0 in 0.626s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:17 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1 Sep 21 16:39:17 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Acquiring lock "cinder-c40b2954-6c0f-47f9-a733-cd78362df639-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "cinder-c40b2954-6c0f-47f9-a733-cd78362df639-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Acquiring lock "cinder-quobyte-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "cinder-quobyte-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Acquiring lock "cinder-quobyte-c40b2954-6c0f-47f9-a733-cd78362df639" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:18 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "cinder-quobyte-c40b2954-6c0f-47f9-a733-cd78362df639" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Deleting offline snapshot c40b2954-6c0f-47f9-a733-cd78362df639 of volume a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] snapshot_file for this snap is: volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1" returned: 0 in 0.445s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083ea77e-f677-412b-91e4-2b807ab46672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13bedbfd-c786-4ac7-881c-45c2fc2835e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57d76cf-0610-4582-8518-4e507b92ba17]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:18 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Volume volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1 (05fbfba4-ab47-421a-94b2-ed16f4ebbff1): created successfully Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13bedbfd-c786-4ac7-881c-45c2fc2835e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Flow 'volume_create_manager' (b8ba53cb-9ebc-4420-b735-ea142d228218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:39:18 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-5e95fb73-da53-4058-a91f-787af62e0c78 req-c928c8c4-50ed-4c8d-9b56-b10faef9bce7 tempest-AttachVolumeNegativeTest-1864958692 None] Terminate volume connection completed successfully. Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-5e95fb73-da53-4058-a91f-787af62e0c78 req-c928c8c4-50ed-4c8d-9b56-b10faef9bce7 tempest-AttachVolumeNegativeTest-1864958692 None] Deleting attachment 94d9d1a1-d71a-4ff7-90d5-d73094015f48. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:39:18 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ddd52065-4144-472c-b30a-e4f251017699 tempest-VolumesTransfersV355Test-1205889109 None] Created volume successfully. Sep 21 16:39:18 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 Sep 21 16:39:18 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:18 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639" returned: 0 in 0.438s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c819db5-1198-425a-a091-dc4eda36e8f9]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:18 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b Sep 21 16:39:18 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Acquiring lock "cinder-05fbfba4-ab47-421a-94b2-ed16f4ebbff1-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Lock "cinder-05fbfba4-ab47-421a-94b2-ed16f4ebbff1-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Acquiring lock "cinder-quobyte-05fbfba4-ab47-421a-94b2-ed16f4ebbff1" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Lock "cinder-quobyte-05fbfba4-ab47-421a-94b2-ed16f4ebbff1" acquired by "delete_volume" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:19 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b" returned: 0 in 0.596s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:19 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1b6b80-2268-4dd1-8493-a8fd07f056fb]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:19 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 Sep 21 16:39:19 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:19 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1 Sep 21 16:39:19 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:20 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639" returned: 0 in 0.719s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:20 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1" returned: 0 in 0.724s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:20 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639 Sep 21 16:39:20 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:20 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1 Sep 21 16:39:20 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:20 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b.c40b2954-6c0f-47f9-a733-cd78362df639" returned: 0 in 0.371s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:20 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-05fbfba4-ab47-421a-94b2-ed16f4ebbff1" returned: 0 in 0.396s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "cinder-quobyte-c40b2954-6c0f-47f9-a733-cd78362df639" released by "_delete_snapshot" :: held 2.328s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Lock "cinder-quobyte-05fbfba4-ab47-421a-94b2-ed16f4ebbff1" released by "delete_volume" :: held 1.203s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "cinder-quobyte-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b" released by "delete_snapshot" :: held 2.387s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Created reservations ['f19fe112-6bc0-4488-abaa-e0dbe751fcb8', '07f72345-cfa7-4bfe-95da-d42e501e0ac4', 'f7ccc18a-114d-45cc-a1d0-c3fa9d4a5dc4', '722b5320-fc17-4960-9fc3-f2a3f23480d5'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Created reservations ['3b67ed2e-de1f-4f43-91ca-e655ea7d38c8', '0e28487c-8582-462e-9c63-93bce0156328', 'eefa75a3-e8f8-4293-a2bf-606c02a85cac', 'f7bdd378-07ec-41ef-954f-4a6e8399865d'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:20 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Delete snapshot completed successfully. Sep 21 16:39:20 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:39:20 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9304ef92-f5f8-4e71-b517-f35c808baa8d tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "cinder-c40b2954-6c0f-47f9-a733-cd78362df639-delete_snapshot" released by "delete_snapshot" :: held 2.681s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:21 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.329s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:21 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:39:21 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Deleted volume successfully. Sep 21 16:39:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-662c268f-9867-4a3c-9017-8b95fc10c12d tempest-VolumesTransfersV355Test-368023564 None] Lock "cinder-05fbfba4-ab47-421a-94b2-ed16f4ebbff1-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Acquiring lock "cinder-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "cinder-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Acquiring lock "cinder-quobyte-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "cinder-quobyte-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:21 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[73086793-a2df-4701-944d-69d51c9a6421]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:21 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b Sep 21 16:39:21 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:22 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b" returned: 0 in 0.563s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:22 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b Sep 21 16:39:22 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:22 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b" returned: 0 in 0.274s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "cinder-quobyte-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b" released by "delete_volume" :: held 0.950s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:22 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Created reservations ['d2eda345-5e5c-44ca-b32d-0b6d3f480c53', 'cbea2ef2-c3dc-47ae-b192-e100fb9078ea', 'c24c658a-bf49-4521-bd82-cf172c594947', 'f995183a-05b2-447a-8eed-be93fe18a8c1'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:39:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:22 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:39:22 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:23 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.422s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:23 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:39:23 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Deleted volume successfully. Sep 21 16:39:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2e57cc00-1f7d-42f3-8c3b-c1ad952ca751 tempest-VolumeSnapshotQuotasNegativeTestJSON-2102233864 None] Lock "cinder-a98d5f7a-1c0c-4c7b-af2b-2d515e0a552b-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:32 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=19,cinder:UPDATE=26,cinder:INSERT=7 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:39:33 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:DELETE=4,cinder:SELECT=16,cinder:UPDATE=22,cinder:INSERT=6 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Flow 'volume_create_manager' (ca9ce6ed-8ebe-4768-bc84-6b140d50a841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558c3273-b418-476d-bd28-75a561cf1f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558c3273-b418-476d-bd28-75a561cf1f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1422979149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c608d274-cbbf-457c-be67-6c818d840378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add9a2a5e23544d6b43731be65155d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:39:34Z,use_quota=True,user_id='b025a5d0412e471290ba320cdd50054c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b725fd-3e9f-42fd-bb4d-d7f279d76252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b725fd-3e9f-42fd-bb4d-d7f279d76252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279b2101-494a-424e-9dbb-c7dfe5245bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279b2101-494a-424e-9dbb-c7dfe5245bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c608d274-cbbf-457c-be67-6c818d840378', 'volume_name': 'volume-c608d274-cbbf-457c-be67-6c818d840378', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6360a55f-3347-44ef-83b0-808ce7d77771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6360a55f-3347-44ef-83b0-808ce7d77771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d62b49f-ee3b-4a69-80b5-8f4bff3b8768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:34 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Volume c608d274-cbbf-457c-be67-6c818d840378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c608d274-cbbf-457c-be67-6c818d840378', 'volume_size': 1} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1422979149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c608d274-cbbf-457c-be67-6c818d840378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add9a2a5e23544d6b43731be65155d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:39:34Z,use_quota=True,user_id='b025a5d0412e471290ba320cdd50054c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Creating volume c608d274-cbbf-457c-be67-6c818d840378 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:39:34 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:39:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:34 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 1073741824 Sep 21 16:39:34 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:35 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 1073741824" returned: 0 in 0.778s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:35 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 Sep 21 16:39:35 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:35 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378" returned: 0 in 0.370s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d62b49f-ee3b-4a69-80b5-8f4bff3b8768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c608d274-cbbf-457c-be67-6c818d840378', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbc35df-0338-443b-9e82-6cf420346882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:35 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Volume volume-c608d274-cbbf-457c-be67-6c818d840378 (c608d274-cbbf-457c-be67-6c818d840378): created successfully Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbc35df-0338-443b-9e82-6cf420346882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Flow 'volume_create_manager' (ca9ce6ed-8ebe-4768-bc84-6b140d50a841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:39:35 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6d462317-6c6c-481d-8829-2ffe0c26525b tempest-VolumesCloneTest-516638643 None] Created volume successfully. Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Flow 'volume_create_manager' (9dbdc6c3-6be2-46c3-9d6e-4d247add7839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b9d8cf-a3b4-46f3-abe9-7341460f215d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b9d8cf-a3b4-46f3-abe9-7341460f215d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-855900264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58468fb3-2a18-4d64-9b90-d11bfd1a6f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0119a5b4aefa472ab5e49d136cbca7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:39:36Z,use_quota=True,user_id='0c54406252b54291a80e863859cdc903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cc780a2-f020-44c3-92d4-533f4cdb572a),volume_type_id=5cc780a2-f020-44c3-92d4-533f4cdb572a)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b412034e-7b60-4e29-b8d9-27945af789a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b412034e-7b60-4e29-b8d9-27945af789a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cdf2af-ac89-429e-9cae-132603663471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cdf2af-ac89-429e-9cae-132603663471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58468fb3-2a18-4d64-9b90-d11bfd1a6f40', 'volume_name': 'volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0388777-20d1-4d5b-b6c3-7989ff7f3096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0388777-20d1-4d5b-b6c3-7989ff7f3096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc34fac-718a-492d-84a0-381821f8c819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:35 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Volume 58468fb3-2a18-4d64-9b90-d11bfd1a6f40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40', 'volume_size': 1} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-855900264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58468fb3-2a18-4d64-9b90-d11bfd1a6f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0119a5b4aefa472ab5e49d136cbca7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:39:36Z,use_quota=True,user_id='0c54406252b54291a80e863859cdc903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cc780a2-f020-44c3-92d4-533f4cdb572a),volume_type_id=5cc780a2-f020-44c3-92d4-533f4cdb572a)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Creating volume 58468fb3-2a18-4d64-9b90-d11bfd1a6f40 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:39:35 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:39:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:35 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40 1073741824 Sep 21 16:39:35 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:36 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40 1073741824" returned: 0 in 0.696s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:36 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40 Sep 21 16:39:36 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:37 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40" returned: 0 in 0.439s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc34fac-718a-492d-84a0-381821f8c819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2809d04e-4e7f-48e2-aa8a-169f6b64a81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:37 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Volume volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40 (58468fb3-2a18-4d64-9b90-d11bfd1a6f40): created successfully Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2809d04e-4e7f-48e2-aa8a-169f6b64a81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Flow 'volume_create_manager' (9dbdc6c3-6be2-46c3-9d6e-4d247add7839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:39:37 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-30fb68d8-d7e9-40e0-b4e8-a14a8a5452df tempest-VolumeTypesAccessTest-342408351 None] Created volume successfully. Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Flow 'volume_create_manager' (292be772-93c5-42f8-bb41-0006bf7f02f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ae489c-ed4a-44f2-8175-a96b07049698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ae489c-ed4a-44f2-8175-a96b07049698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1758162318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622ce45a-1e04-423e-ac81-e85968bd6e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add9a2a5e23544d6b43731be65155d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:39:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c608d274-cbbf-457c-be67-6c818d840378,status='creating',terminated_at=None,updated_at=2026-09-21T14:39:37Z,use_quota=True,user_id='b025a5d0412e471290ba320cdd50054c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4caca7-3dad-42f2-981a-f8ef3942867f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4caca7-3dad-42f2-981a-f8ef3942867f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cafe94-2148-44a2-8785-3e63fb0205bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cafe94-2148-44a2-8785-3e63fb0205bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '622ce45a-1e04-423e-ac81-e85968bd6e8a', 'volume_name': 'volume-622ce45a-1e04-423e-ac81-e85968bd6e8a', 'volume_size': 2, 'source_volid': 'c608d274-cbbf-457c-be67-6c818d840378', 'source_volstatus': 'available'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3152e73-4b37-4ca1-a398-39636c39213f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3152e73-4b37-4ca1-a398-39636c39213f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9d37e7-a3e2-4f31-8b6a-e11fd5e0be55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:37 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Volume 622ce45a-1e04-423e-ac81-e85968bd6e8a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-622ce45a-1e04-423e-ac81-e85968bd6e8a', 'volume_size': 2, 'source_volid': 'c608d274-cbbf-457c-be67-6c818d840378', 'source_volstatus': 'available'} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:37 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Cloning volume c608d274-cbbf-457c-be67-6c818d840378 to volume 622ce45a-1e04-423e-ac81-e85968bd6e8a Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Creating offline snapshot 4be153ec-54d1-4222-bd62-78e128540cfe of volume c608d274-cbbf-457c-be67-6c818d840378 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[062b71cd-98ce-419a-b22c-f54a1ee92650]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:37 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 Sep 21 16:39:37 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Acquiring lock "cinder-58468fb3-2a18-4d64-9b90-d11bfd1a6f40-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Lock "cinder-58468fb3-2a18-4d64-9b90-d11bfd1a6f40-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:38 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378" returned: 0 in 0.647s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Acquiring lock "cinder-quobyte-58468fb3-2a18-4d64-9b90-d11bfd1a6f40" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:38 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe 1G Sep 21 16:39:38 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Lock "cinder-quobyte-58468fb3-2a18-4d64-9b90-d11bfd1a6f40" acquired by "delete_volume" :: waited 0.110s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:38 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fb8ede-d813-4423-ac38-5611ace24d21]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:38 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40 Sep 21 16:39:38 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:39 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe 1G" returned: 0 in 0.867s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c608d274-cbbf-457c-be67-6c818d840378 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:39 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c608d274-cbbf-457c-be67-6c818d840378 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe Sep 21 16:39:39 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:39 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40" returned: 0 in 1.010s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:39 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40 Sep 21 16:39:39 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:39 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c608d274-cbbf-457c-be67-6c818d840378 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe" returned: 0 in 0.604s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:39 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe is being set with open permissions: ugo+rw Sep 21 16:39:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:39 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe Sep 21 16:39:39 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:39 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-58468fb3-2a18-4d64-9b90-d11bfd1a6f40" returned: 0 in 0.524s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Lock "cinder-quobyte-58468fb3-2a18-4d64-9b90-d11bfd1a6f40" released by "delete_volume" :: held 1.682s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:40 devstack cinder-volume[86030]: WARNING cinder.quota [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-421576668 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-421576668, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:39:40 devstack cinder-volume[86030]: WARNING cinder.quota [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-421576668 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-421576668, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:39:40 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Created reservations ['d0ffef8e-85e2-44ed-b128-0981aa2eb441', 'e4126a60-7212-4fea-9da1-2c2bacf9bd18', 'a5cd539d-902a-49e1-a41d-341604067f3b', '97bf074e-f2c0-4ed1-a2d2-e4e8a89e896d'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:39:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:40 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe" returned: 0 in 0.688s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:40 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:39:40 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:40 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.info Sep 21 16:39:40 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:40 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.info" returned: 0 in 0.479s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:40 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.info is being set with open permissions: ugo+rw Sep 21 16:39:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:41 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:41 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.info Sep 21 16:39:41 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.763s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:39:41 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Deleted volume successfully. Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-566d2a8f-a7df-49e3-9bc8-22cb9110f43e tempest-VolumeTypesAccessTest-342408351 None] Lock "cinder-58468fb3-2a18-4d64-9b90-d11bfd1a6f40-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:41 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.info" returned: 0 in 0.745s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Acquiring lock "cinder-quobyte-622ce45a-1e04-423e-ac81-e85968bd6e8a" by "_copy_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Lock "cinder-quobyte-622ce45a-1e04-423e-ac81-e85968bd6e8a" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] snapshot: 4be153ec-54d1-4222-bd62-78e128540cfe, volume: 622ce45a-1e04-423e-ac81-e85968bd6e8a, {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a42721-0134-4c1e-bb4e-d6fb8cf90dc6]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:42 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe Sep 21 16:39:42 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:43 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe" returned: 0 in 1.140s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c608d274-cbbf-457c-be67-6c818d840378(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:39:43 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac2b493-20ab-4e3a-b5fc-7e991187731a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:43 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 Sep 21 16:39:43 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:43 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378" returned: 0 in 0.606s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 16:39:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Creating direct copy from snapshot {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 16:39:43 devstack cinder-volume[86030]: DEBUG cinder.utils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Path /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a not found in is_blk_device check {{(pid=86030) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 21 16:39:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:43 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a Sep 21 16:39:43 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:50 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=15,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:39:51 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=13,cinder:SELECT=11,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:39:57 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a" returned: 0 in 13.694s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:57 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378, size 1024.00 MB, duration 13.69 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:39:57 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Converted 1024.00 MB image at 74.77 MB/s Sep 21 16:39:57 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a is being set with open permissions: ugo+rw Sep 21 16:39:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:57 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a Sep 21 16:39:57 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:57 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a" returned: 0 in 0.285s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Lock "cinder-quobyte-622ce45a-1e04-423e-ac81-e85968bd6e8a" released by "_copy_volume_from_snapshot" :: held 15.958s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Acquiring lock "cinder-quobyte-4be153ec-54d1-4222-bd62-78e128540cfe" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:39:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Lock "cinder-quobyte-4be153ec-54d1-4222-bd62-78e128540cfe" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:39:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Deleting offline snapshot 4be153ec-54d1-4222-bd62-78e128540cfe of volume c608d274-cbbf-457c-be67-6c818d840378 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:39:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] snapshot_file for this snap is: volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:39:57 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c26465-52eb-4bb7-aaa4-eabbddc1d0cb]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:57 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe Sep 21 16:39:57 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:58 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe" returned: 0 in 0.453s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c608d274-cbbf-457c-be67-6c818d840378(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:39:58 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[757ef2e2-9418-4fdd-9f4e-4d7d0b3fc4f9]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:39:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:58 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 Sep 21 16:39:58 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:58 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378" returned: 0 in 0.608s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:58 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe Sep 21 16:39:58 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:59 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe" returned: 0 in 0.432s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:39:59 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe Sep 21 16:39:59 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:39:59 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Sep 21 16:39:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378.4be153ec-54d1-4222-bd62-78e128540cfe" returned: 0 in 0.244s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:39:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Lock "cinder-quobyte-4be153ec-54d1-4222-bd62-78e128540cfe" released by "_delete_snapshot" :: held 1.845s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:39:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.185s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:39:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9d37e7-a3e2-4f31-8b6a-e11fd5e0be55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622ce45a-1e04-423e-ac81-e85968bd6e8a', 'volume_size': 2, 'source_volid': 'c608d274-cbbf-457c-be67-6c818d840378', 'source_volstatus': 'available'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a9387f-4263-4919-b4af-bef63a186718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:39:59 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Volume volume-622ce45a-1e04-423e-ac81-e85968bd6e8a (622ce45a-1e04-423e-ac81-e85968bd6e8a): created successfully Sep 21 16:39:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a9387f-4263-4919-b4af-bef63a186718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:39:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Flow 'volume_create_manager' (292be772-93c5-42f8-bb41-0006bf7f02f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:39:59 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-cf607d09-e412-4236-a22d-512af23526f9 tempest-VolumesCloneTest-516638643 None] Created volume successfully. Sep 21 16:40:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Acquiring lock "cinder-622ce45a-1e04-423e-ac81-e85968bd6e8a-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Lock "cinder-622ce45a-1e04-423e-ac81-e85968bd6e8a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Acquiring lock "cinder-quobyte-622ce45a-1e04-423e-ac81-e85968bd6e8a" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Lock "cinder-quobyte-622ce45a-1e04-423e-ac81-e85968bd6e8a" acquired by "delete_volume" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:00 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec67f6ed-f4bd-402f-a7a9-c675dbbb78ee]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:00 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a Sep 21 16:40:00 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:00 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a" returned: 0 in 0.386s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:00 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a Sep 21 16:40:00 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:01 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-622ce45a-1e04-423e-ac81-e85968bd6e8a" returned: 0 in 0.291s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Lock "cinder-quobyte-622ce45a-1e04-423e-ac81-e85968bd6e8a" released by "delete_volume" :: held 0.744s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Created reservations ['b7b83a3c-b69f-48f0-bed5-2d2c90dda538', '3d0b6364-7276-4ecd-ad37-5bfa713afd9c', 'e3b1fc70-3f3e-4dcd-9f40-b1d6a9a0f6a1', '20922ee4-d8ee-44ed-b06d-046a7fd3991e'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:01 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:40:01 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:01 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.286s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:40:01 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Deleted volume successfully. Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-af870494-7c85-4c12-a8c8-3295334cb71e tempest-VolumesCloneTest-516638643 None] Lock "cinder-622ce45a-1e04-423e-ac81-e85968bd6e8a-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Acquiring lock "cinder-c608d274-cbbf-457c-be67-6c818d840378-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Lock "cinder-c608d274-cbbf-457c-be67-6c818d840378-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Acquiring lock "cinder-quobyte-c608d274-cbbf-457c-be67-6c818d840378" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Lock "cinder-quobyte-c608d274-cbbf-457c-be67-6c818d840378" acquired by "delete_volume" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:02 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f3df86-ded9-4deb-8cae-53f457dfdef0]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:02 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 Sep 21 16:40:02 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:02 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378" returned: 0 in 0.441s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:02 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378 Sep 21 16:40:02 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:02 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c608d274-cbbf-457c-be67-6c818d840378" returned: 0 in 0.307s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Lock "cinder-quobyte-c608d274-cbbf-457c-be67-6c818d840378" released by "delete_volume" :: held 0.857s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:02 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Created reservations ['869e9d6c-6293-45af-a39a-c0164d41c778', '35002f24-af80-4898-a328-8fefdc755def', '45d4a85a-6e5e-4b1b-930c-7b2226ba3b79', 'b75f76fb-89ce-4d10-9be9-f7b8d4101ec7'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:40:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:03 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:40:03 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:03 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.295s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:03 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:40:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Deleted volume successfully. Sep 21 16:40:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b389069c-3713-49e7-a8e7-9bc913a3146d tempest-VolumesCloneTest-516638643 None] Lock "cinder-c608d274-cbbf-457c-be67-6c818d840378-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Flow 'volume_create_manager' (f551e552-e9ed-46ab-b35e-e6cecd83d8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8306f3b-2e31-4a53-be53-3bb29c2aab11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8306f3b-2e31-4a53-be53-3bb29c2aab11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2005826788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a6b694-6866-4d27-b72c-76c133a005de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71df9ed60e8425bae2a7585ea3d6dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:06Z,use_quota=True,user_id='09b5152badbc40afbff6224872247168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb87ec3c-9e7e-4aa3-b7b6-af56c528d4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb87ec3c-9e7e-4aa3-b7b6-af56c528d4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f27356-ffff-4202-bee6-701cee45875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f27356-ffff-4202-bee6-701cee45875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a6b694-6866-4d27-b72c-76c133a005de', 'volume_name': 'volume-d0a6b694-6866-4d27-b72c-76c133a005de', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66900e5d-daec-4ef0-97dd-68d3ad12ed62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66900e5d-daec-4ef0-97dd-68d3ad12ed62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a990d9-b7a8-46ee-8aba-7abb8918d3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:06 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Volume d0a6b694-6866-4d27-b72c-76c133a005de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a6b694-6866-4d27-b72c-76c133a005de', 'volume_size': 1} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2005826788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a6b694-6866-4d27-b72c-76c133a005de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71df9ed60e8425bae2a7585ea3d6dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:06Z,use_quota=True,user_id='09b5152badbc40afbff6224872247168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Creating volume d0a6b694-6866-4d27-b72c-76c133a005de {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:40:06 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:40:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d0a6b694-6866-4d27-b72c-76c133a005de 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:06 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d0a6b694-6866-4d27-b72c-76c133a005de 1073741824 Sep 21 16:40:06 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:07 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d0a6b694-6866-4d27-b72c-76c133a005de 1073741824" returned: 0 in 0.593s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d0a6b694-6866-4d27-b72c-76c133a005de {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:07 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d0a6b694-6866-4d27-b72c-76c133a005de Sep 21 16:40:07 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:07 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d0a6b694-6866-4d27-b72c-76c133a005de" returned: 0 in 0.324s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a990d9-b7a8-46ee-8aba-7abb8918d3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a6b694-6866-4d27-b72c-76c133a005de', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3b4d4e-037c-4ac7-b7f5-a5021b8b3e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:07 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Volume volume-d0a6b694-6866-4d27-b72c-76c133a005de (d0a6b694-6866-4d27-b72c-76c133a005de): created successfully Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3b4d4e-037c-4ac7-b7f5-a5021b8b3e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Flow 'volume_create_manager' (f551e552-e9ed-46ab-b35e-e6cecd83d8c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:07 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-86e1b833-7ee0-4c11-ab46-429db7e38b74 tempest-AttachVolumeNegativeTest-1864958692 None] Created volume successfully. Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:40:07 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:40:07 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Flow 'volume_create_manager' (68b46cd1-9307-4a23-80b5-4c597e93805c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446c4eed-ccaa-47ad-afa6-6ce4b3836d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446c4eed-ccaa-47ad-afa6-6ce4b3836d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1174125289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f660cc7b-2536-41e7-b2d5-d77c36314cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5de84f7ea654b08a68149d1aa2f549f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:08Z,use_quota=True,user_id='0534f6ffcd22423d85d83bebb90ec0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfb1129-1af3-45f4-9ca3-17e99ec7985c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfb1129-1af3-45f4-9ca3-17e99ec7985c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28288aa9-0713-448d-ad82-ad02a99e62f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28288aa9-0713-448d-ad82-ad02a99e62f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f660cc7b-2536-41e7-b2d5-d77c36314cc6', 'volume_name': 'volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6', 'volume_size': 2}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814925ce-5935-4041-8417-bd303f05541f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814925ce-5935-4041-8417-bd303f05541f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428a73b1-121b-47da-9012-ca9316b7da87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:07 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Volume f660cc7b-2536-41e7-b2d5-d77c36314cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6', 'volume_size': 2} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1174125289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f660cc7b-2536-41e7-b2d5-d77c36314cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5de84f7ea654b08a68149d1aa2f549f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:08Z,use_quota=True,user_id='0534f6ffcd22423d85d83bebb90ec0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Creating volume f660cc7b-2536-41e7-b2d5-d77c36314cc6 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:40:07 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:40:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6 2147483648 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:08 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6 2147483648 Sep 21 16:40:08 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:08 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.354s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:40:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:40:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 28 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:40:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:40:08 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6 2147483648" returned: 0 in 0.633s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:08 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6 Sep 21 16:40:08 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:08 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6" returned: 0 in 0.301s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:40:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428a73b1-121b-47da-9012-ca9316b7da87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6', 'volume_size': 2}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a372b39-78a6-469a-9e33-dc80b8f45796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:09 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Volume volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6 (f660cc7b-2536-41e7-b2d5-d77c36314cc6): created successfully Sep 21 16:40:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a372b39-78a6-469a-9e33-dc80b8f45796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Flow 'volume_create_manager' (68b46cd1-9307-4a23-80b5-4c597e93805c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:09 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-67f56c68-988e-442c-81cd-dea3f894663b tempest-VolumesCloneNegativeTest-660044470 None] Created volume successfully. Sep 21 16:40:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-6e858024-7091-4649-aeeb-0dbbc57014d3 req-c773ba15-9573-4025-84da-7f0bb9330de4 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-6e858024-7091-4649-aeeb-0dbbc57014d3 req-c773ba15-9573-4025-84da-7f0bb9330de4 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-6e858024-7091-4649-aeeb-0dbbc57014d3 req-c773ba15-9573-4025-84da-7f0bb9330de4 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-6e858024-7091-4649-aeeb-0dbbc57014d3 req-c773ba15-9573-4025-84da-7f0bb9330de4 tempest-AttachVolumeNegativeTest-1864958692 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-d0a6b694-6866-4d27-b72c-76c133a005de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef6dc5f4-880e-4abb-b536-6b40f511cedc', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:40:09 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-6e858024-7091-4649-aeeb-0dbbc57014d3 req-c773ba15-9573-4025-84da-7f0bb9330de4 tempest-AttachVolumeNegativeTest-1864958692 None] attachment_update completed successfully. Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Acquiring lock "cinder-f660cc7b-2536-41e7-b2d5-d77c36314cc6-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Lock "cinder-f660cc7b-2536-41e7-b2d5-d77c36314cc6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Acquiring lock "cinder-quobyte-f660cc7b-2536-41e7-b2d5-d77c36314cc6" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Lock "cinder-quobyte-f660cc7b-2536-41e7-b2d5-d77c36314cc6" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7988903-53ec-442f-a778-fd3e67476784]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:10 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6 Sep 21 16:40:10 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:10 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6" returned: 0 in 0.437s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:10 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6 Sep 21 16:40:10 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Flow 'volume_create_manager' (dbd5b6b8-89cc-4f5e-9854-bf83923d9bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cb8c33-74ef-4428-8f48-4409c7849753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cb8c33-74ef-4428-8f48-4409c7849753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1894171850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b88c1d0-e4e6-40bc-8991-7325f26d0f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517b6c58f2454d69a576c95fcee2f896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:11Z,use_quota=True,user_id='5aebcf61306449649cb495dd49063eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb740e5-d883-45e6-bcc4-124ac306176c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb740e5-d883-45e6-bcc4-124ac306176c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be82b4b-bbee-422c-9ec4-f114425fcf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:10 devstack cinder-volume[86030]: DEBUG cinder.image.glance [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Creating Keystone auth plugin from conf {{(pid=86030) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 16:40:11 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f660cc7b-2536-41e7-b2d5-d77c36314cc6" returned: 0 in 0.298s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Lock "cinder-quobyte-f660cc7b-2536-41e7-b2d5-d77c36314cc6" released by "delete_volume" :: held 0.800s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be82b4b-bbee-422c-9ec4-f114425fcf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b88c1d0-e4e6-40bc-8991-7325f26d0f22', 'volume_name': 'volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb25242-68db-43cf-b3eb-5532f0644911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb25242-68db-43cf-b3eb-5532f0644911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d39c896-5ec6-47db-9881-e29a5591ef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:11 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Volume 6b88c1d0-e4e6-40bc-8991-7325f26d0f22: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Trying to clone 6b88c1d0-e4e6-40bc-8991-7325f26d0f22 from image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]). {{(pid=86030) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Created reservations ['bbbed84a-2e71-4a5e-8d93-9b59d0cc9a10', 'ed89bc0f-f3bd-48d9-ac17-d6ed1469319b', 'f18d1ba4-ec2a-4f23-a6b1-c79c03102b74', '598ef61e-385b-4105-a70a-119d886afb40'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:11 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:40:11 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:11 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.355s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:40:11 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Deleted volume successfully. Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 16:40:11 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Image download 20.69 MB at 20.69 MB/s Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b2937877-44f2-4f84-92fe-dc4f8c833c5c tempest-VolumesCloneNegativeTest-660044470 None] Lock "cinder-f660cc7b-2536-41e7-b2d5-d77c36314cc6-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc387ac0-ed35-460c-b4fc-31772cc857b8]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:11 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD Sep 21 16:40:11 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:12 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Temporary image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c is fetched for user 5aebcf61306449649cb495dd49063eed. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9f72ee-dee2-4e1a-8108-8072c3f37347]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:12 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-80f32bcf-5add-4184-8e59-5482e9c212d1 req-10c2aca6-bcd3-4169-a548-7b2273fd0565 tempest-AttachVolumeNegativeTest-1864958692 None] Terminate volume connection completed successfully. Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-80f32bcf-5add-4184-8e59-5482e9c212d1 req-10c2aca6-bcd3-4169-a548-7b2273fd0565 tempest-AttachVolumeNegativeTest-1864958692 None] Deleting attachment ef6dc5f4-880e-4abb-b536-6b40f511cedc. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:40:12 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD Sep 21 16:40:12 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:12 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1894171850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b88c1d0-e4e6-40bc-8991-7325f26d0f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517b6c58f2454d69a576c95fcee2f896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:11Z,use_quota=True,user_id='5aebcf61306449649cb495dd49063eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Creating volume 6b88c1d0-e4e6-40bc-8991-7325f26d0f22 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:40:12 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:40:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:12 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 1073741824 Sep 21 16:40:12 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:13 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 1073741824" returned: 0 in 0.581s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:13 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 Sep 21 16:40:13 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:13 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22" returned: 0 in 0.466s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:40:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:13 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:40:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Flow 'volume_create_manager' (119b0571-7ced-4fd2-ad45-208e7a9d07cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9c77f8-be17-4848-8c75-de26945c305f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:13 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Attempting download of 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}])) to volume 6b88c1d0-e4e6-40bc-8991-7325f26d0f22. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 21 16:40:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9c77f8-be17-4848-8c75-de26945c305f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-335615600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38509a1-be67-45ba-97a6-081068b93b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be2368a2509d40aa99e71cbe652ded53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:14Z,use_quota=True,user_id='d54f020679e14abb86f671018170d4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a6bb38-72fd-4aa0-afee-5cfa5d4de383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a6bb38-72fd-4aa0-afee-5cfa5d4de383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1efbb2-b6a4-4298-8bf0-a56523e663af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1efbb2-b6a4-4298-8bf0-a56523e663af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c38509a1-be67-45ba-97a6-081068b93b25', 'volume_name': 'volume-c38509a1-be67-45ba-97a6-081068b93b25', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16408f0f-3e7e-43ea-9133-186f8899ee3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16408f0f-3e7e-43ea-9133-186f8899ee3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8029f548-de8e-4958-b13a-5844d99d50a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:14 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Volume c38509a1-be67-45ba-97a6-081068b93b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c38509a1-be67-45ba-97a6-081068b93b25', 'volume_size': 1} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-335615600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38509a1-be67-45ba-97a6-081068b93b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be2368a2509d40aa99e71cbe652ded53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:14Z,use_quota=True,user_id='d54f020679e14abb86f671018170d4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Creating volume c38509a1-be67-45ba-97a6-081068b93b25 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:40:14 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c38509a1-be67-45ba-97a6-081068b93b25 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e0a5e7-e2d8-4db5-8306-31edb451138d]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_5pkrzeyb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:14 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c38509a1-be67-45ba-97a6-081068b93b25 1073741824 Sep 21 16:40:14 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:14 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_5pkrzeyb Sep 21 16:40:14 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:14 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_5pkrzeyb" returned: 0 in 0.395s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_5pkrzeyb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:14 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_5pkrzeyb Sep 21 16:40:14 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:14 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c38509a1-be67-45ba-97a6-081068b93b25 1073741824" returned: 0 in 0.636s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c38509a1-be67-45ba-97a6-081068b93b25 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:14 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c38509a1-be67-45ba-97a6-081068b93b25 Sep 21 16:40:14 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:14 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_5pkrzeyb" returned: 1 in 0.487s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_5pkrzeyb' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffd8edf-eff7-4b4d-a24c-128ffa01bd4a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:15 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c38509a1-be67-45ba-97a6-081068b93b25" returned: 0 in 0.414s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:40:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8029f548-de8e-4958-b13a-5844d99d50a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c38509a1-be67-45ba-97a6-081068b93b25', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914ea31c-77db-4a27-bf2b-6c0c9d419a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:15 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Volume volume-c38509a1-be67-45ba-97a6-081068b93b25 (c38509a1-be67-45ba-97a6-081068b93b25): created successfully Sep 21 16:40:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914ea31c-77db-4a27-bf2b-6c0c9d419a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Flow 'volume_create_manager' (119b0571-7ced-4fd2-ad45-208e7a9d07cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:15 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD Sep 21 16:40:15 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:15 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-210ed3e5-4544-4709-8a4b-9e15bd73c3fe tempest-AttachVolumeShelveTestJSON-1814573172 None] Created volume successfully. Sep 21 16:40:15 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:15 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c was qcow2, converting to qcow2 {{(pid=86030) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 16:40:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:15 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 Sep 21 16:40:15 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Flow 'volume_create_manager' (92c26e0f-418f-4712-991a-16d9b415b66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2ece81-a5d5-4022-9cc1-35905de427da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2ece81-a5d5-4022-9cc1-35905de427da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1967040035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0e07e9-042d-4432-9c8d-6dc212a276c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae7f21c18164353978c097f6df42a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:16Z,use_quota=True,user_id='b67f000b559b4971ad5c36d02bcae4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50dc8a2-d54e-46eb-a196-0f0817adc520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50dc8a2-d54e-46eb-a196-0f0817adc520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fddf83-0d90-48ef-bb62-1b22c99d4de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fddf83-0d90-48ef-bb62-1b22c99d4de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0e07e9-042d-4432-9c8d-6dc212a276c1', 'volume_name': 'volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7f0621-8207-4b7d-bb35-d182c9029add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7f0621-8207-4b7d-bb35-d182c9029add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa9662c-abd0-4ea0-b5ba-94e069f73041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:16 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Volume ef0e07e9-042d-4432-9c8d-6dc212a276c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1', 'volume_size': 1} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1967040035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0e07e9-042d-4432-9c8d-6dc212a276c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae7f21c18164353978c097f6df42a2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:16Z,use_quota=True,user_id='b67f000b559b4971ad5c36d02bcae4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Creating volume ef0e07e9-042d-4432-9c8d-6dc212a276c1 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:40:16 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:40:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:16 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1 1073741824 Sep 21 16:40:16 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:17 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1 1073741824" returned: 0 in 0.579s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:17 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1 Sep 21 16:40:17 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:17 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1" returned: 0 in 0.325s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:40:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa9662c-abd0-4ea0-b5ba-94e069f73041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372a7d75-ae76-4255-9c79-296861bc97ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:17 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Volume volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1 (ef0e07e9-042d-4432-9c8d-6dc212a276c1): created successfully Sep 21 16:40:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372a7d75-ae76-4255-9c79-296861bc97ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Flow 'volume_create_manager' (92c26e0f-418f-4712-991a-16d9b415b66e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:17 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4862fdd8-fc63-43cc-b6ff-8a8094530a7b tempest-VolumesNegativeTest-593785760 None] Created volume successfully. Sep 21 16:40:18 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22" returned: 0 in 2.670s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:18 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_m6u81qlpdevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:40:18 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Converted 112.00 MB image at 41.93 MB/s Sep 21 16:40:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:18 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 1G Sep 21 16:40:18 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:18 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 1G" returned: 0 in 0.401s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:18 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Downloaded image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}])) to volume 6b88c1d0-e4e6-40bc-8991-7325f26d0f22 successfully. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 21 16:40:18 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Temporary image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c for user 5aebcf61306449649cb495dd49063eed is deleted. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 16:40:18 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Marking volume 6b88c1d0-e4e6-40bc-8991-7325f26d0f22 as bootable. {{(pid=86030) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 21 16:40:18 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Copying metadata from image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c to 6b88c1d0-e4e6-40bc-8991-7325f26d0f22. {{(pid=86030) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 16:40:18 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Creating volume glance metadata for volume 6b88c1d0-e4e6-40bc-8991-7325f26d0f22 backed by image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86030) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 16:40:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d39c896-5ec6-47db-9881-e29a5591ef2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1ea698-b247-4e1b-a645-ca69b0b67eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:18 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Volume volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 (6b88c1d0-e4e6-40bc-8991-7325f26d0f22): created successfully Sep 21 16:40:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1ea698-b247-4e1b-a645-ca69b0b67eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Flow 'volume_create_manager' (dbd5b6b8-89cc-4f5e-9854-bf83923d9bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:18 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-322628b6-6f1b-45d3-8071-e1a8f961aa0f tempest-VolumesImageMetadata-1478962567 None] Created volume successfully. Sep 21 16:40:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Acquiring lock "cinder-6b88c1d0-e4e6-40bc-8991-7325f26d0f22-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Lock "cinder-6b88c1d0-e4e6-40bc-8991-7325f26d0f22-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Acquiring lock "cinder-quobyte-6b88c1d0-e4e6-40bc-8991-7325f26d0f22" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Lock "cinder-quobyte-6b88c1d0-e4e6-40bc-8991-7325f26d0f22" acquired by "delete_volume" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:20 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[366a7e08-850e-4bf2-b303-2a2a4095beaa]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:20 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 Sep 21 16:40:20 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:21 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22" returned: 0 in 0.586s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:21 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22 Sep 21 16:40:21 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:21 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6b88c1d0-e4e6-40bc-8991-7325f26d0f22" returned: 0 in 0.425s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Lock "cinder-quobyte-6b88c1d0-e4e6-40bc-8991-7325f26d0f22" released by "delete_volume" :: held 1.108s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:21 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Created reservations ['7bf2e234-3c02-4ca5-8b55-a3ad57129f7a', 'c743f317-14dc-4b37-a389-397fe009cf7a', '09277701-bd07-4a23-8950-489b4d311f72', '20f840d8-cb59-4b60-9394-f8496bb82be3'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:40:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:21 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:40:21 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:22 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.408s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:22 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:40:22 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Deleted volume successfully. Sep 21 16:40:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23a42af9-7673-4e07-8ee5-8a291d247acc tempest-VolumesImageMetadata-1478962567 None] Lock "cinder-6b88c1d0-e4e6-40bc-8991-7325f26d0f22-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-73c40dca-b582-4b1f-ab69-dd803249645e req-7a320325-d296-4c3e-98eb-3ecf874a35e6 tempest-AttachVolumeShelveTestJSON-1814573172 None] No connector for attachment 505e5e17-ced9-4a4b-9c40-40cb0f8b102e; skipping storage backend terminate_connection call. {{(pid=86030) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 21 16:40:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-73c40dca-b582-4b1f-ab69-dd803249645e req-7a320325-d296-4c3e-98eb-3ecf874a35e6 tempest-AttachVolumeShelveTestJSON-1814573172 None] Deleting attachment 505e5e17-ced9-4a4b-9c40-40cb0f8b102e. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Flow 'volume_create_manager' (99195721-cd04-43f4-ac61-a6635167de72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8f271e-848b-4084-a55a-3b64cbfb7e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8f271e-848b-4084-a55a-3b64cbfb7e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-808932029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49e190b-dff7-46d7-a1dd-ff1c4ac3a966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e202841c1d432b8c3391c829b9c4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:37Z,use_quota=True,user_id='df6892a7324742ec8fa8f856448b4115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23f18ac-d21e-47e3-9215-abef9433856c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23f18ac-d21e-47e3-9215-abef9433856c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015d8694-080e-4444-86d8-c74b5c285bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015d8694-080e-4444-86d8-c74b5c285bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd49e190b-dff7-46d7-a1dd-ff1c4ac3a966', 'volume_name': 'volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe5c3bd-6087-45eb-bc42-3f5c49ea4d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe5c3bd-6087-45eb-bc42-3f5c49ea4d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac41d79-411c-4a54-b6fe-e2edeb7f516e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:37 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Volume d49e190b-dff7-46d7-a1dd-ff1c4ac3a966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966', 'volume_size': 1} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-808932029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49e190b-dff7-46d7-a1dd-ff1c4ac3a966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e202841c1d432b8c3391c829b9c4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:37Z,use_quota=True,user_id='df6892a7324742ec8fa8f856448b4115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Creating volume d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:40:37 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:40:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:37 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 1073741824 Sep 21 16:40:37 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:38 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 1073741824" returned: 0 in 0.876s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:38 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 Sep 21 16:40:38 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:39 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" returned: 0 in 0.522s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:40:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac41d79-411c-4a54-b6fe-e2edeb7f516e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01db77e8-2ed4-423e-a812-73ec65f12c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:39 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Volume volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 (d49e190b-dff7-46d7-a1dd-ff1c4ac3a966): created successfully Sep 21 16:40:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01db77e8-2ed4-423e-a812-73ec65f12c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Flow 'volume_create_manager' (99195721-cd04-43f4-ac61-a6635167de72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:39 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-2c9403df-f597-4dfd-b5d2-926e233a8113 tempest-VolumesDeleteCascade-969589961 None] Created volume successfully. Sep 21 16:40:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] Creating offline snapshot 44eddecb-0344-40e7-987a-1865ead43193 of volume d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:40:39 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5794011-218a-4599-9ae1-2517e16c63e0]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:40 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 Sep 21 16:40:40 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:40 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" returned: 0 in 0.645s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:40 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 1G Sep 21 16:40:40 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:41 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 1G" returned: 0 in 0.571s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:41 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 Sep 21 16:40:41 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:41 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193" returned: 0 in 0.337s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:41 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 is being set with open permissions: ugo+rw Sep 21 16:40:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:41 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 Sep 21 16:40:41 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:41 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193" returned: 0 in 0.299s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:41 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.info Sep 21 16:40:41 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:42 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.info" returned: 0 in 0.406s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:42 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.info is being set with open permissions: ugo+rw Sep 21 16:40:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:42 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.info Sep 21 16:40:42 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:42 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.info" returned: 0 in 0.303s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.718s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:42 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-13a7b890-8f92-47a7-9521-daefb94cbf69 tempest-VolumesDeleteCascade-969589961 None] Create snapshot completed successfully Sep 21 16:40:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] Creating offline snapshot 8f3d536f-8015-419f-b317-aed5496b393d of volume d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:40:43 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd90c3b7-abda-4350-8eca-37b8b334a4b2]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:43 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 Sep 21 16:40:43 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:44 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193" returned: 0 in 0.547s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:40:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:44 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d 1G Sep 21 16:40:44 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:45 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d 1G" returned: 0 in 0.947s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:45 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d Sep 21 16:40:45 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:45 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d" returned: 0 in 0.701s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:45 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d is being set with open permissions: ugo+rw Sep 21 16:40:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:45 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d Sep 21 16:40:45 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:46 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d" returned: 0 in 0.556s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.968s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Acquiring lock "cinder-ef0e07e9-042d-4432-9c8d-6dc212a276c1-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Lock "cinder-ef0e07e9-042d-4432-9c8d-6dc212a276c1-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d257e1fb-40f1-49bc-bdd1-79e81c1680c1 tempest-VolumesDeleteCascade-969589961 None] Create snapshot completed successfully Sep 21 16:40:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Acquiring lock "cinder-quobyte-ef0e07e9-042d-4432-9c8d-6dc212a276c1" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Lock "cinder-quobyte-ef0e07e9-042d-4432-9c8d-6dc212a276c1" acquired by "delete_volume" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:46 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5966bf7-d924-4868-aae9-c4188ebc4bc5]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:46 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1 Sep 21 16:40:46 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:47 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1" returned: 0 in 0.479s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:47 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1 Sep 21 16:40:47 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:47 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ef0e07e9-042d-4432-9c8d-6dc212a276c1" returned: 0 in 0.283s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Lock "cinder-quobyte-ef0e07e9-042d-4432-9c8d-6dc212a276c1" released by "delete_volume" :: held 0.822s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:47 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Created reservations ['5fe65b37-3bb4-4a7f-b096-cffd17b8a7a7', '1c80474e-de22-4ee9-bcf2-83f784614ab4', '1f8182bd-850d-4040-8f32-a65598711b85', '9a454de0-16d9-4c2d-a509-c01459da87f4'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:40:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:47 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:40:47 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:48 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Performing cascade delete. {{(pid=86030) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.413s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:40:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Deleted volume successfully. Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-44eddecb-0344-40e7-987a-1865ead43193-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-56240675-4233-4e5a-8ec3-5c99e8fdf9a2 tempest-VolumesNegativeTest-593785760 None] Lock "cinder-ef0e07e9-042d-4432-9c8d-6dc212a276c1-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-44eddecb-0344-40e7-987a-1865ead43193-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-quobyte-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-quobyte-44eddecb-0344-40e7-987a-1865ead43193" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-44eddecb-0344-40e7-987a-1865ead43193" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Deleting offline snapshot 44eddecb-0344-40e7-987a-1865ead43193 of volume d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] snapshot_file for this snap is: volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f0765b-adc4-4f17-9229-aa7b3cfcee43]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:48 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 Sep 21 16:40:48 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:48 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193" returned: 0 in 0.519s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db885de-76bb-487d-a39e-c08bac572554]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:49 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 Sep 21 16:40:49 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:49 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" returned: 0 in 0.526s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:49 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[145d2cf4-3196-4348-a9ec-0a22017b1e17]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:49 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d Sep 21 16:40:49 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:49 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d" returned: 0 in 0.446s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:40:50 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b28d3dd-248a-4f52-9469-b0d540aecdcf]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:50 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 Sep 21 16:40:50 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:50 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193" returned: 0 in 0.393s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:50 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:40:50 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fc3393-05f0-46d9-8eda-876987d17320]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:50 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 Sep 21 16:40:50 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:50 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" returned: 0 in 0.423s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:50 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 Sep 21 16:40:50 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:51 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193" returned: 0 in 0.400s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:51 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193 Sep 21 16:40:51 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:51 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.44eddecb-0344-40e7-987a-1865ead43193" returned: 0 in 0.314s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d -F qcow2 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:51 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d -F qcow2 Sep 21 16:40:51 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:51 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d -F qcow2" returned: 0 in 0.352s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-44eddecb-0344-40e7-987a-1865ead43193" released by "_delete_snapshot" :: held 3.685s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" released by "delete_snapshot" :: held 3.729s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=64,cinder:SELECT=62,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=72,cinder:SELECT=65,cinder:INSERT=24,cinder:DELETE=8 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Created reservations ['7bf5dfe2-eb20-4500-a568-e87d323dd20e', '01b0795e-8569-45b5-a3e4-552e1a4da23c', 'ffde669a-3235-40e7-8a8a-ee9cd3435835', '9bf21c70-7060-48b0-8222-92c3c1f5b41a'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:40:52 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Delete snapshot completed successfully. Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-44eddecb-0344-40e7-987a-1865ead43193-delete_snapshot" released by "delete_snapshot" :: held 3.984s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-8f3d536f-8015-419f-b317-aed5496b393d-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-8f3d536f-8015-419f-b317-aed5496b393d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-quobyte-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-quobyte-8f3d536f-8015-419f-b317-aed5496b393d" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-8f3d536f-8015-419f-b317-aed5496b393d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Deleting offline snapshot 8f3d536f-8015-419f-b317-aed5496b393d of volume d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] snapshot_file for this snap is: volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2cc28f-86de-494f-9526-d78cb4f0f0d0]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Flow 'volume_create_manager' (c3578631-b352-4d52-a6ff-1dca98cb8adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71caf041-5000-48d5-9705-874b38e4a47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71caf041-5000-48d5-9705-874b38e4a47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1271853734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb85e9efabd480b9a2895fe22047b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:52Z,use_quota=True,user_id='b8f9d15bd409471f9bb1a9248a2c0212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73ffad7-67ac-46b0-b5dd-47ad368a8805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73ffad7-67ac-46b0-b5dd-47ad368a8805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1789a962-c648-416e-81bc-5b18f7b5631d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1789a962-c648-416e-81bc-5b18f7b5631d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d', 'volume_name': 'volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d', 'volume_size': 2}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23909b4d-4dad-4635-be14-8d2384fd9871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:52 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d Sep 21 16:40:52 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23909b4d-4dad-4635-be14-8d2384fd9871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8cde3ef-7e8d-46a1-8ca3-a24e538f6953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:52 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Volume 8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d', 'volume_size': 2} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1271853734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bb85e9efabd480b9a2895fe22047b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:52Z,use_quota=True,user_id='b8f9d15bd409471f9bb1a9248a2c0212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Creating volume 8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:40:52 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d 2147483648 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:52 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d 2147483648 Sep 21 16:40:52 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:52 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d" returned: 0 in 0.533s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20743ae-f5a7-4911-8429-910675880a57]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:53 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 Sep 21 16:40:53 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:53 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d 2147483648" returned: 0 in 0.687s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:53 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d Sep 21 16:40:53 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:53 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" returned: 0 in 0.492s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:53 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d Sep 21 16:40:53 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:53 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d" returned: 0 in 0.331s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:40:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8cde3ef-7e8d-46a1-8ca3-a24e538f6953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d', 'volume_size': 2}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e60455-21ae-4587-9943-846937200a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:53 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Volume volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d (8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d): created successfully Sep 21 16:40:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e60455-21ae-4587-9943-846937200a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Flow 'volume_create_manager' (c3578631-b352-4d52-a6ff-1dca98cb8adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:53 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b2ece6ea-fdcb-459e-9ec3-64993656dc5c tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Created volume successfully. Sep 21 16:40:53 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d" returned: 0 in 0.396s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:53 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d Sep 21 16:40:53 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:54 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966.8f3d536f-8015-419f-b317-aed5496b393d" returned: 0 in 0.277s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-8f3d536f-8015-419f-b317-aed5496b393d" released by "_delete_snapshot" :: held 1.837s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" released by "delete_snapshot" :: held 1.878s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Created reservations ['2cf454d1-0951-4967-9d25-6a21a8946c0f', '4642152f-b8ca-49fd-8cb1-6288546b01ba', 'd736dcc7-354b-414a-a1d7-a9b298470a90', '3554c96e-f241-4e39-b268-14d7e3f2903e'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:40:54 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Delete snapshot completed successfully. Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-8f3d536f-8015-419f-b317-aed5496b393d-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Snapshots deleted, issuing volume delete {{(pid=86030) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-quobyte-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36ae487-ce23-4e71-b64b-e4ef2c121696]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:54 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 Sep 21 16:40:54 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Creating offline snapshot 76ab8745-b1cc-43ee-982b-b047d359efd8 of volume 8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b7b645-a5b2-4fb6-9e1e-2a14609d6e46]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:54 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d Sep 21 16:40:54 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:54 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" returned: 0 in 0.454s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:54 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966 Sep 21 16:40:54 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:55 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d" returned: 0 in 0.384s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 2G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:55 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 2G Sep 21 16:40:55 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:55 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" returned: 0 in 0.270s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966" released by "delete_volume" :: held 0.808s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Created reservations ['59e26e0f-18ed-42b2-aa10-2530533dd1dd', '0eaaef46-dec0-4a8b-bd52-0a8781752900', '5dcfa326-901e-4b7b-8fbb-6a731dc4b8c4', '0d01ab62-c960-45d5-b45a-ed60933dea0e'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:55 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:40:55 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:55 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 2G" returned: 0 in 0.410s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:55 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 Sep 21 16:40:55 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:55 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.276s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:40:55 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Deleted volume successfully. Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a6092d54-67a2-429f-a90a-4a9ed324b804 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-d49e190b-dff7-46d7-a1dd-ff1c4ac3a966-delete_volume" released by "delete_volume" :: held 7.573s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:55 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8" returned: 0 in 0.356s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:55 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 is being set with open permissions: ugo+rw Sep 21 16:40:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:55 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 Sep 21 16:40:55 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:56 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8" returned: 0 in 0.288s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:56 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.info Sep 21 16:40:56 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:56 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.info" returned: 0 in 0.304s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:56 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.info is being set with open permissions: ugo+rw Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:56 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.info Sep 21 16:40:56 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Flow 'volume_create_manager' (52a1c87b-1e6f-4582-a6c2-b1561a961972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5ae131-b8ad-407e-a0f5-b4e7ba3a6fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5ae131-b8ad-407e-a0f5-b4e7ba3a6fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1074209699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8034f79c-c8a0-48f5-a82e-0cd777f161c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e202841c1d432b8c3391c829b9c4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:57Z,use_quota=True,user_id='df6892a7324742ec8fa8f856448b4115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30213a48-ac64-4570-92fd-3964172390db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30213a48-ac64-4570-92fd-3964172390db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859f295b-9948-409c-9f57-55ad4bb64697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859f295b-9948-409c-9f57-55ad4bb64697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8034f79c-c8a0-48f5-a82e-0cd777f161c2', 'volume_name': 'volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc89491-0abe-4327-bafb-00f80120b05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebc89491-0abe-4327-bafb-00f80120b05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b412af-a18b-40b6-a765-02d633b1be5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:56 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Volume 8034f79c-c8a0-48f5-a82e-0cd777f161c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2', 'volume_size': 1} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:56 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.info" returned: 0 in 0.302s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.051s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1074209699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8034f79c-c8a0-48f5-a82e-0cd777f161c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e202841c1d432b8c3391c829b9c4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:57Z,use_quota=True,user_id='df6892a7324742ec8fa8f856448b4115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Creating volume 8034f79c-c8a0-48f5-a82e-0cd777f161c2 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:40:56 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:40:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:56 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 1073741824 Sep 21 16:40:56 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:56 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4d6c7b11-a663-4591-a6ad-319ec40643a0 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Create snapshot completed successfully Sep 21 16:40:57 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 1073741824" returned: 0 in 0.413s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:57 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 Sep 21 16:40:57 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:57 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2" returned: 0 in 0.278s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b412af-a18b-40b6-a765-02d633b1be5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4057a304-c38f-4d8d-b0fd-0634444f0333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:57 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Volume volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 (8034f79c-c8a0-48f5-a82e-0cd777f161c2): created successfully Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4057a304-c38f-4d8d-b0fd-0634444f0333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Flow 'volume_create_manager' (52a1c87b-1e6f-4582-a6c2-b1561a961972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:57 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-11b3173f-a003-4226-aea1-92f902b78c37 tempest-VolumesDeleteCascade-969589961 None] Created volume successfully. Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Acquiring lock "cinder-76ab8745-b1cc-43ee-982b-b047d359efd8-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "cinder-76ab8745-b1cc-43ee-982b-b047d359efd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Acquiring lock "cinder-quobyte-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "cinder-quobyte-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Acquiring lock "cinder-quobyte-76ab8745-b1cc-43ee-982b-b047d359efd8" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "cinder-quobyte-76ab8745-b1cc-43ee-982b-b047d359efd8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Deleting offline snapshot 76ab8745-b1cc-43ee-982b-b047d359efd8 of volume 8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:40:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] snapshot_file for this snap is: volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86f0e1a-f163-4380-876d-ed5ce54a9a73]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Flow 'volume_create_manager' (ed6e3a4c-3900-4e93-9dcd-427cff794ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e24d043-29cc-408f-b9c4-369524ed33f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e24d043-29cc-408f-b9c4-369524ed33f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1906205278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36cbdb23-8dc1-4e88-a87c-bb79d6a55681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71df9ed60e8425bae2a7585ea3d6dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:58Z,use_quota=True,user_id='09b5152badbc40afbff6224872247168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574229ef-4766-45c0-961f-a63aa4d32ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (574229ef-4766-45c0-961f-a63aa4d32ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af90fe1a-d2fc-4165-9752-71db89264db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af90fe1a-d2fc-4165-9752-71db89264db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36cbdb23-8dc1-4e88-a87c-bb79d6a55681', 'volume_name': 'volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf26d8d-810a-492f-9ebc-ce6f79981c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf26d8d-810a-492f-9ebc-ce6f79981c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f5b06df-ba59-4d8b-a756-b266988affee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:58 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Volume 36cbdb23-8dc1-4e88-a87c-bb79d6a55681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681', 'volume_size': 1} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1906205278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36cbdb23-8dc1-4e88-a87c-bb79d6a55681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71df9ed60e8425bae2a7585ea3d6dbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:40:58Z,use_quota=True,user_id='09b5152badbc40afbff6224872247168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Creating volume 36cbdb23-8dc1-4e88-a87c-bb79d6a55681 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:40:58 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:40:58 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:40:58 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:58 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681 1073741824 Sep 21 16:40:58 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:58 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8" returned: 0 in 0.426s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[64787cfa-d7ec-4d85-9903-8442e0e7a0f8]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:58 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d Sep 21 16:40:58 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:58 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681 1073741824" returned: 0 in 0.495s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:58 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681 Sep 21 16:40:58 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:40:59 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d" returned: 0 in 0.576s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:59 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 Sep 21 16:40:59 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:59 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681" returned: 0 in 0.411s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.099s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f5b06df-ba59-4d8b-a756-b266988affee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426bbc71-8125-4008-af02-69a37b241338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] Creating offline snapshot 290af530-18dc-407f-9143-8b3b8a9ae7bf of volume 8034f79c-c8a0-48f5-a82e-0cd777f161c2 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:40:59 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Volume volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681 (36cbdb23-8dc1-4e88-a87c-bb79d6a55681): created successfully Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426bbc71-8125-4008-af02-69a37b241338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Flow 'volume_create_manager' (ed6e3a4c-3900-4e93-9dcd-427cff794ccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5941254-8a9d-43c0-9b4f-310c4ee010da]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:59 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8f0d9ce3-a1d5-4ab3-806f-5f6b90788e44 tempest-AttachVolumeNegativeTest-1864958692 None] Created volume successfully. Sep 21 16:40:59 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 Sep 21 16:40:59 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:59 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8" returned: 0 in 0.413s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:59 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8 Sep 21 16:40:59 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:59 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2" returned: 0 in 0.450s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:40:59 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf 1G Sep 21 16:40:59 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:40:59 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d.76ab8745-b1cc-43ee-982b-b047d359efd8" returned: 0 in 0.298s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "cinder-quobyte-76ab8745-b1cc-43ee-982b-b047d359efd8" released by "_delete_snapshot" :: held 1.868s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "cinder-quobyte-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d" released by "delete_snapshot" :: held 1.897s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Created reservations ['3072632e-f647-4e7e-a315-fdf1f8fdb516', 'f43b46a9-4409-44bb-ae52-607a97f1a519', '3ec3b0f1-92d1-4c0f-8fce-2ae16c2b2789', '43f8884e-4b36-4a7d-968f-6e1ad815d8cd'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:40:59 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Delete snapshot completed successfully. Sep 21 16:40:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89a27861-369e-4453-893a-9122b849dd7e tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "cinder-76ab8745-b1cc-43ee-982b-b047d359efd8-delete_snapshot" released by "delete_snapshot" :: held 2.051s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Acquiring lock "cinder-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:00 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf 1G" returned: 0 in 0.537s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "cinder-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:00 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf Sep 21 16:41:00 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Acquiring lock "cinder-quobyte-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "cinder-quobyte-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28be93b-8a2b-4e66-a6c0-51f06ca8dd2e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:00 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d Sep 21 16:41:00 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:00 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf" returned: 0 in 0.359s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:00 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf is being set with open permissions: ugo+rw Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:00 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf Sep 21 16:41:00 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:00 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d" returned: 0 in 0.436s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:00 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d Sep 21 16:41:00 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:00 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf" returned: 0 in 0.306s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:00 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.info Sep 21 16:41:00 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-c4176359-5472-4b46-880b-c8822eae0ddc req-861a8d56-396a-4cc7-a019-6cae0eac6e8a tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:01 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d" returned: 0 in 0.317s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "cinder-quobyte-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d" released by "delete_volume" :: held 0.841s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Created reservations ['52733e3b-d0d1-49b6-8364-825df260b7ac', 'f7a9da35-e524-483a-8bf2-6cdcdcea949a', '37f9bdd7-9405-4404-8e85-734c438c2ae5', 'a4208eef-8dc4-4a35-a6fa-0b025f6b7f19'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:01 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.info" returned: 0 in 0.339s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:01 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.info is being set with open permissions: ugo+rw Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:01 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:41:01 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:01 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.info Sep 21 16:41:01 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:01 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.271s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:41:01 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Deleted volume successfully. Sep 21 16:41:01 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.info" returned: 0 in 0.268s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-c4176359-5472-4b46-880b-c8822eae0ddc req-861a8d56-396a-4cc7-a019-6cae0eac6e8a tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.453s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-c4176359-5472-4b46-880b-c8822eae0ddc req-861a8d56-396a-4cc7-a019-6cae0eac6e8a tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4d9d46ad-3652-405c-b964-122a0f22b7d7 tempest-VolumesSnapshotNegativeTestJSON-218665869 None] Lock "cinder-8aad6f7a-1778-4b1b-a2c6-ab5c84b6409d-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:01 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b34609c7-2301-4188-9eb4-9cde40d07a4d tempest-VolumesDeleteCascade-969589961 None] Create snapshot completed successfully Sep 21 16:41:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-c4176359-5472-4b46-880b-c8822eae0ddc req-861a8d56-396a-4cc7-a019-6cae0eac6e8a tempest-AttachVolumeNegativeTest-1864958692 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c81e8c5-b486-4261-9baa-ddd1cdffe178', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:41:01 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-c4176359-5472-4b46-880b-c8822eae0ddc req-861a8d56-396a-4cc7-a019-6cae0eac6e8a tempest-AttachVolumeNegativeTest-1864958692 None] attachment_update completed successfully. Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Flow 'volume_create_manager' (7aaf2bb6-48b3-43be-bd23-e9f638995c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ab3ba1-7c8e-45a4-85cd-6f1d8f2e8775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ab3ba1-7c8e-45a4-85cd-6f1d8f2e8775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1155562477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a5503c3-c623-421d-be47-2e624c4a0d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94e202841c1d432b8c3391c829b9c4b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=290af530-18dc-407f-9143-8b3b8a9ae7bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:03Z,use_quota=True,user_id='df6892a7324742ec8fa8f856448b4115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d3971a-20ec-43cc-8f6f-69008f22904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d3971a-20ec-43cc-8f6f-69008f22904e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4f4c0e-4336-4c87-8153-0020723c58ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4f4c0e-4336-4c87-8153-0020723c58ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9a5503c3-c623-421d-be47-2e624c4a0d4f', 'volume_name': 'volume-9a5503c3-c623-421d-be47-2e624c4a0d4f', 'volume_size': 1, 'snapshot_id': '290af530-18dc-407f-9143-8b3b8a9ae7bf'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea4c858-e099-41e3-84d8-e54e2117b488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea4c858-e099-41e3-84d8-e54e2117b488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481f0d3e-635a-4e39-90e8-7ece7cd2d5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:02 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Volume 9a5503c3-c623-421d-be47-2e624c4a0d4f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9a5503c3-c623-421d-be47-2e624c4a0d4f', 'volume_size': 1, 'snapshot_id': '290af530-18dc-407f-9143-8b3b8a9ae7bf'} Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-quobyte-290af530-18dc-407f-9143-8b3b8a9ae7bf-9a5503c3-c623-421d-be47-2e624c4a0d4f" by "_create_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-290af530-18dc-407f-9143-8b3b8a9ae7bf-9a5503c3-c623-421d-be47-2e624c4a0d4f" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Creating volume 9a5503c3-c623-421d-be47-2e624c4a0d4f from snapshot 290af530-18dc-407f-9143-8b3b8a9ae7bf {{(pid=86030) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-quobyte-9a5503c3-c623-421d-be47-2e624c4a0d4f" by "_copy_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-9a5503c3-c623-421d-be47-2e624c4a0d4f" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] snapshot: 290af530-18dc-407f-9143-8b3b8a9ae7bf, volume: 9a5503c3-c623-421d-be47-2e624c4a0d4f, {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6930420c-4582-4154-b541-405c384a1ad1]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:03 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf Sep 21 16:41:03 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:03 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf" returned: 0 in 0.452s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[3248010e-0275-4d4d-9aff-d73d5f26b50a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:03 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 Sep 21 16:41:03 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-51c938b4-947f-4902-8af8-745b549ede58 req-9215ea4f-7989-490d-8bd0-75013c24cf57 tempest-AttachVolumeNegativeTest-1864958692 None] Terminate volume connection completed successfully. Sep 21 16:41:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-51c938b4-947f-4902-8af8-745b549ede58 req-9215ea4f-7989-490d-8bd0-75013c24cf57 tempest-AttachVolumeNegativeTest-1864958692 None] Deleting attachment 2c81e8c5-b486-4261-9baa-ddd1cdffe178. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:41:04 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2" returned: 0 in 0.501s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 16:41:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Creating direct copy from snapshot {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 16:41:04 devstack cinder-volume[86030]: DEBUG cinder.utils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Path /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f not found in is_blk_device check {{(pid=86030) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 21 16:41:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:04 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f Sep 21 16:41:04 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:41:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:07 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:41:07 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:08 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.857s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:41:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:41:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 28 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:41:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:41:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "cinder-36cbdb23-8dc1-4e88-a87c-bb79d6a55681-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "cinder-36cbdb23-8dc1-4e88-a87c-bb79d6a55681-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "cinder-quobyte-36cbdb23-8dc1-4e88-a87c-bb79d6a55681" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "cinder-quobyte-36cbdb23-8dc1-4e88-a87c-bb79d6a55681" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:12 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a668a48-dbdd-4928-a98f-444287ccfa97]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:12 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681 Sep 21 16:41:12 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:13 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681" returned: 0 in 1.121s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:13 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681 Sep 21 16:41:13 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:14 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-36cbdb23-8dc1-4e88-a87c-bb79d6a55681" returned: 0 in 0.505s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "cinder-quobyte-36cbdb23-8dc1-4e88-a87c-bb79d6a55681" released by "delete_volume" :: held 1.739s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Created reservations ['64385ad5-391a-49b4-a5f7-c760eabfdb8d', '618dc52c-fc55-4e06-b461-4a46bf8a2162', 'c5b08bce-deae-4a33-8f37-ccb99af333c0', 'dab28854-da50-4ce5-9d9e-87d8f3950892'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:14 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:41:14 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:14 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f" returned: 0 in 10.433s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2, size 1024.00 MB, duration 10.43 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:41:14 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Converted 1024.00 MB image at 98.14 MB/s Sep 21 16:41:14 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f is being set with open permissions: ugo+rw Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:14 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f Sep 21 16:41:14 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:14 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.475s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "cinder-d0a6b694-6866-4d27-b72c-76c133a005de-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:14 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Deleted volume successfully. Sep 21 16:41:14 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f" returned: 0 in 0.392s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "cinder-d0a6b694-6866-4d27-b72c-76c133a005de-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-97515663-aa85-4bc2-8298-c7083a5e5e08 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "cinder-36cbdb23-8dc1-4e88-a87c-bb79d6a55681-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-9a5503c3-c623-421d-be47-2e624c4a0d4f" released by "_copy_volume_from_snapshot" :: held 11.929s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "cinder-quobyte-d0a6b694-6866-4d27-b72c-76c133a005de" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-290af530-18dc-407f-9143-8b3b8a9ae7bf-9a5503c3-c623-421d-be47-2e624c4a0d4f" released by "_create_volume_from_snapshot" :: held 12.047s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.069s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "cinder-quobyte-d0a6b694-6866-4d27-b72c-76c133a005de" acquired by "delete_volume" :: waited 0.035s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7fc47f-61a1-47d9-8ea6-b70b5df880a9]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d0a6b694-6866-4d27-b72c-76c133a005de {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481f0d3e-635a-4e39-90e8-7ece7cd2d5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a5503c3-c623-421d-be47-2e624c4a0d4f', 'volume_size': 1, 'snapshot_id': '290af530-18dc-407f-9143-8b3b8a9ae7bf'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406e8d95-a89a-4d7b-833c-dc1e95bd8e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:15 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Volume volume-9a5503c3-c623-421d-be47-2e624c4a0d4f (9a5503c3-c623-421d-be47-2e624c4a0d4f): created successfully Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406e8d95-a89a-4d7b-833c-dc1e95bd8e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Flow 'volume_create_manager' (7aaf2bb6-48b3-43be-bd23-e9f638995c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:15 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6c2122aa-a45a-470a-8db4-f8368c0daae1 tempest-VolumesDeleteCascade-969589961 None] Created volume successfully. Sep 21 16:41:15 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d0a6b694-6866-4d27-b72c-76c133a005de Sep 21 16:41:15 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:15 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d0a6b694-6866-4d27-b72c-76c133a005de" returned: 0 in 0.454s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d0a6b694-6866-4d27-b72c-76c133a005de {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:15 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d0a6b694-6866-4d27-b72c-76c133a005de Sep 21 16:41:15 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-8034f79c-c8a0-48f5-a82e-0cd777f161c2-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-8034f79c-c8a0-48f5-a82e-0cd777f161c2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Performing cascade delete. {{(pid=86030) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-290af530-18dc-407f-9143-8b3b8a9ae7bf-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-290af530-18dc-407f-9143-8b3b8a9ae7bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-quobyte-8034f79c-c8a0-48f5-a82e-0cd777f161c2" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-8034f79c-c8a0-48f5-a82e-0cd777f161c2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-quobyte-290af530-18dc-407f-9143-8b3b8a9ae7bf" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-290af530-18dc-407f-9143-8b3b8a9ae7bf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Deleting offline snapshot 290af530-18dc-407f-9143-8b3b8a9ae7bf of volume 8034f79c-c8a0-48f5-a82e-0cd777f161c2 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] snapshot_file for this snap is: volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1566825b-06f9-42d9-aa9e-4b19e688961e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:15 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d0a6b694-6866-4d27-b72c-76c133a005de" returned: 0 in 0.292s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "cinder-quobyte-d0a6b694-6866-4d27-b72c-76c133a005de" released by "delete_volume" :: held 0.817s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Created reservations ['56fa62de-bc07-4393-b499-4566af8d628b', '475ab701-fdbb-459d-a327-5ca3d39a8c05', '0cd9b0b8-ed2b-4743-946f-4b83114c1ceb', 'fdc7b04e-3dc1-4e6c-93f7-d9e38353545f'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:41:15 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf Sep 21 16:41:15 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:16 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:41:16 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:16 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf" returned: 0 in 0.646s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba789a0-d37d-467b-803c-02d1083a45a8]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:16 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.528s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "cinder-9c739e90-7645-4a89-9c92-fdf13f743c40-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:16 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Deleted volume successfully. Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "cinder-9c739e90-7645-4a89-9c92-fdf13f743c40-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2c59b3df-7f5a-4042-a3a4-d93fe6364b88 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "cinder-d0a6b694-6866-4d27-b72c-76c133a005de-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:16 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 Sep 21 16:41:16 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "cinder-quobyte-9c739e90-7645-4a89-9c92-fdf13f743c40" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "cinder-quobyte-9c739e90-7645-4a89-9c92-fdf13f743c40" acquired by "delete_volume" :: waited 0.043s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[039a8209-ee82-4102-82d6-bc77531ce145]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9c739e90-7645-4a89-9c92-fdf13f743c40 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:16 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9c739e90-7645-4a89-9c92-fdf13f743c40 Sep 21 16:41:16 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:17 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2" returned: 0 in 0.862s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:17 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf Sep 21 16:41:17 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:17 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9c739e90-7645-4a89-9c92-fdf13f743c40" returned: 0 in 0.660s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9c739e90-7645-4a89-9c92-fdf13f743c40 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:17 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9c739e90-7645-4a89-9c92-fdf13f743c40 Sep 21 16:41:17 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:17 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9c739e90-7645-4a89-9c92-fdf13f743c40" returned: 0 in 0.335s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "cinder-quobyte-9c739e90-7645-4a89-9c92-fdf13f743c40" released by "delete_volume" :: held 1.078s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:17 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf" returned: 0 in 0.556s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:17 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Created reservations ['3b39a41b-2481-4678-956d-1c9ed2351a2c', '581c3ecb-1f24-4e03-8801-8ded2ff6d8df', '5726a013-50db-4f05-a529-deb248a88fa9', '4cb1f37a-cee7-4bb0-a082-d32c6a87fd1e'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:41:18 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf Sep 21 16:41:18 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:18 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:41:18 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:18 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.346s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:41:18 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Deleted volume successfully. Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ec80998a-d71c-4bc0-b573-dabb82b9fe04 tempest-AttachVolumeNegativeTest-1864958692 None] Lock "cinder-9c739e90-7645-4a89-9c92-fdf13f743c40-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:18 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2.290af530-18dc-407f-9143-8b3b8a9ae7bf" returned: 0 in 0.590s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-290af530-18dc-407f-9143-8b3b8a9ae7bf" released by "_delete_snapshot" :: held 2.807s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-8034f79c-c8a0-48f5-a82e-0cd777f161c2" released by "delete_snapshot" :: held 2.839s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Created reservations ['82854c6d-be26-4b1a-a6b8-649e305eec7e', '6951bb83-461e-4faf-b49d-7e0d4b095fdc', '483a56dc-b184-47de-80ee-fa4cf508cc45', '472ae62c-963b-42bf-9b73-616ce8b1f3a2'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Acquiring lock "cinder-c38509a1-be67-45ba-97a6-081068b93b25-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Lock "cinder-c38509a1-be67-45ba-97a6-081068b93b25-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Acquiring lock "cinder-quobyte-c38509a1-be67-45ba-97a6-081068b93b25" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:18 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Delete snapshot completed successfully. Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-290af530-18dc-407f-9143-8b3b8a9ae7bf-delete_snapshot" released by "delete_snapshot" :: held 3.163s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Snapshots deleted, issuing volume delete {{(pid=86030) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-quobyte-8034f79c-c8a0-48f5-a82e-0cd777f161c2" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Lock "cinder-quobyte-c38509a1-be67-45ba-97a6-081068b93b25" acquired by "delete_volume" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-8034f79c-c8a0-48f5-a82e-0cd777f161c2" acquired by "delete_volume" :: waited 0.046s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c035c2-eed8-4dc6-a9c0-cdb8c46d0022]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c38509a1-be67-45ba-97a6-081068b93b25 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:19 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[5642e3dd-ec3d-425f-beb8-3858d0d2716c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:19 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 Sep 21 16:41:19 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:19 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c38509a1-be67-45ba-97a6-081068b93b25 Sep 21 16:41:19 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:19 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2" returned: 0 in 0.502s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:19 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2 Sep 21 16:41:19 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:19 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c38509a1-be67-45ba-97a6-081068b93b25" returned: 0 in 0.630s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c38509a1-be67-45ba-97a6-081068b93b25 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:19 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c38509a1-be67-45ba-97a6-081068b93b25 Sep 21 16:41:19 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:19 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8034f79c-c8a0-48f5-a82e-0cd777f161c2" returned: 0 in 0.328s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-8034f79c-c8a0-48f5-a82e-0cd777f161c2" released by "delete_volume" :: held 0.944s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:19 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c38509a1-be67-45ba-97a6-081068b93b25" returned: 0 in 0.322s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Lock "cinder-quobyte-c38509a1-be67-45ba-97a6-081068b93b25" released by "delete_volume" :: held 1.068s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Created reservations ['912ac53c-1ce2-4f2c-abda-59b5fa3263d8', '74575834-aba6-4232-a95d-1e33ef3628eb', '044dfb6e-9560-4d16-9668-c375c6886cd5', 'f9a76b0e-deb5-4d1f-b055-405e2c1fa0e9'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Created reservations ['2a05c8c5-4520-4c8d-94a3-a8c6bae85994', '6dde8b99-1972-48f8-9b11-b99f3771952f', '88637615-c0ea-47c9-a5e4-c1bfcaf920d6', '34979683-6869-4392-9c7c-149fa7fc78f0'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:20 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:41:20 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:20 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:41:20 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-9a5503c3-c623-421d-be47-2e624c4a0d4f-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-9a5503c3-c623-421d-be47-2e624c4a0d4f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "cinder-quobyte-9a5503c3-c623-421d-be47-2e624c4a0d4f" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-9a5503c3-c623-421d-be47-2e624c4a0d4f" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:20 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.430s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:41:20 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Deleted volume successfully. Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c127ef39-d1ed-4fa3-ab16-492f50abb5ff]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-45920299-1eb4-49c2-abff-6ffcd45c33f7 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-8034f79c-c8a0-48f5-a82e-0cd777f161c2-delete_volume" released by "delete_volume" :: held 4.971s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:20 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.408s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:41:20 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Deleted volume successfully. Sep 21 16:41:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-88c5003a-c729-48c2-a324-740e84fc7fd0 tempest-AttachVolumeShelveTestJSON-1814573172 None] Lock "cinder-c38509a1-be67-45ba-97a6-081068b93b25-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:20 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f Sep 21 16:41:20 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:21 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f" returned: 0 in 0.472s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:21 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f Sep 21 16:41:21 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:21 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a5503c3-c623-421d-be47-2e624c4a0d4f" returned: 0 in 0.363s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-quobyte-9a5503c3-c623-421d-be47-2e624c4a0d4f" released by "delete_volume" :: held 0.919s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:21 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Created reservations ['7098468e-d3ca-48fb-8672-78688881b40a', '29c40248-0d1e-44f4-9b95-5dae344331e8', '3c2c1899-399d-4479-915b-c98be39f212f', 'a4097154-b508-43c5-8fac-4861f3ef07ba'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:41:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:21 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:41:21 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:22 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.411s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:22 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:41:22 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Deleted volume successfully. Sep 21 16:41:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-47d5eca5-c043-40f9-9cf7-fce2236ab423 tempest-VolumesDeleteCascade-969589961 None] Lock "cinder-9a5503c3-c623-421d-be47-2e624c4a0d4f-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:31 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=77,cinder:INSERT=29,cinder:UPDATE=99,cinder:DELETE=7 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:41:32 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=88,cinder:UPDATE=105,cinder:INSERT=25,cinder:DELETE=7 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Flow 'volume_create_manager' (857d7f23-bf73-4ef4-b413-adc19d5b1e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94e9419-e026-4f06-a957-ab4689d45df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94e9419-e026-4f06-a957-ab4689d45df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1375755857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c177ce3-5653-4fae-b5c0-23e229d6c414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a614b236d24505b73656957e0f3316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:33Z,use_quota=True,user_id='45fc74faac4a40668f4f068ca083fdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66700a3c-5238-4cbb-8ce4-c4dd9da7daf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66700a3c-5238-4cbb-8ce4-c4dd9da7daf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58eaa68-127c-4cc1-923a-3a7009dfd44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58eaa68-127c-4cc1-923a-3a7009dfd44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c177ce3-5653-4fae-b5c0-23e229d6c414', 'volume_name': 'volume-8c177ce3-5653-4fae-b5c0-23e229d6c414', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684b5992-ca1e-45ef-84ea-059e627cc5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684b5992-ca1e-45ef-84ea-059e627cc5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a03176-b2df-405b-b381-2e29e3ea0d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:33 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Volume 8c177ce3-5653-4fae-b5c0-23e229d6c414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c177ce3-5653-4fae-b5c0-23e229d6c414', 'volume_size': 1} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1375755857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c177ce3-5653-4fae-b5c0-23e229d6c414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a614b236d24505b73656957e0f3316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:33Z,use_quota=True,user_id='45fc74faac4a40668f4f068ca083fdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Creating volume 8c177ce3-5653-4fae-b5c0-23e229d6c414 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:41:33 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8c177ce3-5653-4fae-b5c0-23e229d6c414 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:33 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8c177ce3-5653-4fae-b5c0-23e229d6c414 1073741824 Sep 21 16:41:33 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:33 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8c177ce3-5653-4fae-b5c0-23e229d6c414 1073741824" returned: 0 in 0.666s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8c177ce3-5653-4fae-b5c0-23e229d6c414 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:34 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8c177ce3-5653-4fae-b5c0-23e229d6c414 Sep 21 16:41:34 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:34 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8c177ce3-5653-4fae-b5c0-23e229d6c414" returned: 0 in 0.379s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a03176-b2df-405b-b381-2e29e3ea0d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c177ce3-5653-4fae-b5c0-23e229d6c414', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d277159-5351-443a-b935-ec3d04552ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:34 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Volume volume-8c177ce3-5653-4fae-b5c0-23e229d6c414 (8c177ce3-5653-4fae-b5c0-23e229d6c414): created successfully Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d277159-5351-443a-b935-ec3d04552ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Flow 'volume_create_manager' (857d7f23-bf73-4ef4-b413-adc19d5b1e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:34 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c603f544-93f2-427d-8bb8-52da27c6b0af tempest-VolumesTransfersTest-32289326 None] Created volume successfully. Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Flow 'volume_create_manager' (1fe9cc6c-306f-4f3a-81b3-df0e533c7a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b5a5f1-4623-4e1d-baed-ec70373b33a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b5a5f1-4623-4e1d-baed-ec70373b33a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-122603294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e448963-eb70-4e05-8eea-86864b78651b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bed0a9e65bd1435d949b1aaf97797dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:34Z,use_quota=True,user_id='b8fa1fa89f9441c69b7ddfa7171012c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af76da0-7596-4ef3-bec0-1ebf9268333d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af76da0-7596-4ef3-bec0-1ebf9268333d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b946a944-e788-45b2-8e0f-a3f83b78d7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b946a944-e788-45b2-8e0f-a3f83b78d7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e448963-eb70-4e05-8eea-86864b78651b', 'volume_name': 'volume-4e448963-eb70-4e05-8eea-86864b78651b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70bc3f0-8c5e-4859-b1a8-22e563b67d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70bc3f0-8c5e-4859-b1a8-22e563b67d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8de48c-67ea-4645-bbbd-9614a1fb24e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:34 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Volume 4e448963-eb70-4e05-8eea-86864b78651b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e448963-eb70-4e05-8eea-86864b78651b', 'volume_size': 1} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-122603294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e448963-eb70-4e05-8eea-86864b78651b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bed0a9e65bd1435d949b1aaf97797dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:34Z,use_quota=True,user_id='b8fa1fa89f9441c69b7ddfa7171012c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Creating volume 4e448963-eb70-4e05-8eea-86864b78651b {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:41:34 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:41:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:34 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b 1073741824 Sep 21 16:41:34 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:35 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b 1073741824" returned: 0 in 0.614s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:35 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b Sep 21 16:41:35 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:35 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b" returned: 0 in 0.372s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:41:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8de48c-67ea-4645-bbbd-9614a1fb24e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e448963-eb70-4e05-8eea-86864b78651b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbfb197-9db9-4289-8062-4e36648132f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:35 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Volume volume-4e448963-eb70-4e05-8eea-86864b78651b (4e448963-eb70-4e05-8eea-86864b78651b): created successfully Sep 21 16:41:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbfb197-9db9-4289-8062-4e36648132f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Flow 'volume_create_manager' (1fe9cc6c-306f-4f3a-81b3-df0e533c7a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:35 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-071e0426-c5cb-4546-8992-b8c7d6bf7eac req-16c3e860-4f95-4f79-af3d-672b03a86729 tempest-VolumesSnapshotsTestJSON-919266857 None] Created volume successfully. Sep 21 16:41:36 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d2a2e505-a358-491f-baab-7fc243745b35 tempest-VolumesTransfersTest-1288908096 None] Transfer volume completed successfully. Sep 21 16:41:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] Creating offline snapshot 82b8d762-be0e-4f36-821e-6f2a922149e7 of volume 4e448963-eb70-4e05-8eea-86864b78651b {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:41:37 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[125fdea3-bc5a-497b-87b5-38925a471530]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:37 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b Sep 21 16:41:37 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Acquiring lock "cinder-8c177ce3-5653-4fae-b5c0-23e229d6c414-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Lock "cinder-8c177ce3-5653-4fae-b5c0-23e229d6c414-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:37 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Acquiring lock "cinder-quobyte-8c177ce3-5653-4fae-b5c0-23e229d6c414" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b" returned: 0 in 0.540s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:37 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 1G Sep 21 16:41:37 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Lock "cinder-quobyte-8c177ce3-5653-4fae-b5c0-23e229d6c414" acquired by "delete_volume" :: waited 0.067s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:37 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae3778b-018a-4155-9675-fd2ef4c9f8ef]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8c177ce3-5653-4fae-b5c0-23e229d6c414 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:37 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8c177ce3-5653-4fae-b5c0-23e229d6c414 Sep 21 16:41:37 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:38 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 1G" returned: 0 in 0.579s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e448963-eb70-4e05-8eea-86864b78651b -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:38 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e448963-eb70-4e05-8eea-86864b78651b -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 Sep 21 16:41:38 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:38 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8c177ce3-5653-4fae-b5c0-23e229d6c414" returned: 0 in 0.577s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8c177ce3-5653-4fae-b5c0-23e229d6c414 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:38 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8c177ce3-5653-4fae-b5c0-23e229d6c414 Sep 21 16:41:38 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:38 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e448963-eb70-4e05-8eea-86864b78651b -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7" returned: 0 in 0.383s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:38 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 is being set with open permissions: ugo+rw Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:38 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 Sep 21 16:41:38 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:38 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8c177ce3-5653-4fae-b5c0-23e229d6c414" returned: 0 in 0.361s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Lock "cinder-quobyte-8c177ce3-5653-4fae-b5c0-23e229d6c414" released by "delete_volume" :: held 0.997s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Created reservations ['8de5c533-cc4d-42dc-aeb1-d33ca8bf0348', '30ef4272-2fe2-4a6d-b936-af14bbd886b3', 'cbcd8a38-1d2d-4224-a4b7-082c8575b20e', '051af638-137f-4c49-aff9-ef8c27d4017a'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:38 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:41:38 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:38 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7" returned: 0 in 0.359s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:39 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.info Sep 21 16:41:39 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:39 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.368s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:39 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:41:39 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Deleted volume successfully. Sep 21 16:41:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-da6710fe-6bd7-414d-baa5-7c6a385ad426 tempest-VolumesTransfersTest-1071911690 None] Lock "cinder-8c177ce3-5653-4fae-b5c0-23e229d6c414-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:39 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.info" returned: 0 in 0.392s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:39 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.info is being set with open permissions: ugo+rw Sep 21 16:41:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:39 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.info Sep 21 16:41:39 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:39 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.info" returned: 0 in 0.296s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.691s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:39 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-1e7f4375-b6f4-4303-b908-e3c0c667f23d req-dcff5a93-9b84-4cca-92fa-2553bb6b805f tempest-VolumesSnapshotsTestJSON-919266857 None] Create snapshot completed successfully Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Acquiring lock "cinder-82b8d762-be0e-4f36-821e-6f2a922149e7-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "cinder-82b8d762-be0e-4f36-821e-6f2a922149e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Acquiring lock "cinder-quobyte-4e448963-eb70-4e05-8eea-86864b78651b" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "cinder-quobyte-4e448963-eb70-4e05-8eea-86864b78651b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Acquiring lock "cinder-quobyte-82b8d762-be0e-4f36-821e-6f2a922149e7" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Flow 'volume_create_manager' (c879c9ff-d2f6-4f4b-b405-2f080b90add6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70943369-acd6-4af8-ae3a-a2c1582ff040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "cinder-quobyte-82b8d762-be0e-4f36-821e-6f2a922149e7" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Deleting offline snapshot 82b8d762-be0e-4f36-821e-6f2a922149e7 of volume 4e448963-eb70-4e05-8eea-86864b78651b {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] snapshot_file for this snap is: volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70943369-acd6-4af8-ae3a-a2c1582ff040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1252845027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf03ce08-abc6-40f8-809b-7d585544c187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a614b236d24505b73656957e0f3316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:40Z,use_quota=True,user_id='45fc74faac4a40668f4f068ca083fdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8be22f2-0505-44e9-a9b6-09199b79ee16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8be22f2-0505-44e9-a9b6-09199b79ee16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85864ad7-44e4-4ffc-bb7f-732dbec0043a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85864ad7-44e4-4ffc-bb7f-732dbec0043a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf03ce08-abc6-40f8-809b-7d585544c187', 'volume_name': 'volume-bf03ce08-abc6-40f8-809b-7d585544c187', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d26433-e2a0-4885-bb5c-c88307334d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d26433-e2a0-4885-bb5c-c88307334d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c47603-118c-4771-961a-a3f8ed00efc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:40 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Volume bf03ce08-abc6-40f8-809b-7d585544c187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf03ce08-abc6-40f8-809b-7d585544c187', 'volume_size': 1} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1252845027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf03ce08-abc6-40f8-809b-7d585544c187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a614b236d24505b73656957e0f3316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:40Z,use_quota=True,user_id='45fc74faac4a40668f4f068ca083fdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Creating volume bf03ce08-abc6-40f8-809b-7d585544c187 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:41:40 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bf03ce08-abc6-40f8-809b-7d585544c187 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b9cee8-bdb6-425e-be19-5b120ff058bb]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:40 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bf03ce08-abc6-40f8-809b-7d585544c187 1073741824 Sep 21 16:41:40 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:40 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 Sep 21 16:41:40 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:41 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7" returned: 0 in 0.481s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e448963-eb70-4e05-8eea-86864b78651b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[d936338c-9f06-43b5-871d-529343af0e2e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:41 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bf03ce08-abc6-40f8-809b-7d585544c187 1073741824" returned: 0 in 0.660s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:41 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b Sep 21 16:41:41 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bf03ce08-abc6-40f8-809b-7d585544c187 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:41 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bf03ce08-abc6-40f8-809b-7d585544c187 Sep 21 16:41:41 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:41 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bf03ce08-abc6-40f8-809b-7d585544c187" returned: 0 in 0.364s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c47603-118c-4771-961a-a3f8ed00efc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf03ce08-abc6-40f8-809b-7d585544c187', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:41 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4aae82c-972e-4a30-8469-0f33c1476292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b" returned: 0 in 0.581s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:41 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Volume volume-bf03ce08-abc6-40f8-809b-7d585544c187 (bf03ce08-abc6-40f8-809b-7d585544c187): created successfully Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4aae82c-972e-4a30-8469-0f33c1476292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:41 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 Sep 21 16:41:41 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Flow 'volume_create_manager' (c879c9ff-d2f6-4f4b-b405-2f080b90add6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:41 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0efee744-266d-4063-9177-e04e6be7e439 tempest-VolumesTransfersTest-32289326 None] Created volume successfully. Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Flow 'volume_create_manager' (4c839032-9636-4363-89b0-e41485aad4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0791d2ab-6ac1-4f0b-94db-78cd0b5fe927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0791d2ab-6ac1-4f0b-94db-78cd0b5fe927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1703801539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0eb0a3-38f8-4696-81b6-75ed00cd88a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6729dfac7394ed39b9723b2077a20f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:42Z,use_quota=True,user_id='ae6499e85a534485a5b0ba07d8cf400a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a61efc1a-643a-49a3-bb2e-21b7fcd4a837),volume_type_id=a61efc1a-643a-49a3-bb2e-21b7fcd4a837)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a8a0df-e662-4629-838c-7f444b942041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a8a0df-e662-4629-838c-7f444b942041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2215787-aa1d-4287-a973-658692c82a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2215787-aa1d-4287-a973-658692c82a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f0eb0a3-38f8-4696-81b6-75ed00cd88a9', 'volume_name': 'volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2655a6d-aa1e-48d3-843a-e26734c11f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2655a6d-aa1e-48d3-843a-e26734c11f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279037f1-edb5-457a-819a-2acc99b0949d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:42 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Volume 0f0eb0a3-38f8-4696-81b6-75ed00cd88a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9', 'volume_size': 1} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1703801539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0eb0a3-38f8-4696-81b6-75ed00cd88a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6729dfac7394ed39b9723b2077a20f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:42Z,use_quota=True,user_id='ae6499e85a534485a5b0ba07d8cf400a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a61efc1a-643a-49a3-bb2e-21b7fcd4a837),volume_type_id=a61efc1a-643a-49a3-bb2e-21b7fcd4a837)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Creating volume 0f0eb0a3-38f8-4696-81b6-75ed00cd88a9 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:41:42 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:42 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9 1073741824 Sep 21 16:41:42 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:42 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7" returned: 0 in 0.575s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:42 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7 Sep 21 16:41:42 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Flow 'volume_create_manager' (16dd368c-653f-4776-a644-6ef74f73f2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71bd022f-1a90-46ef-bbe9-8c7ea89181ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71bd022f-1a90-46ef-bbe9-8c7ea89181ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-728959972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197c2428-6f9f-4d57-bd58-6f8e4738b585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6729dfac7394ed39b9723b2077a20f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:42Z,use_quota=True,user_id='ae6499e85a534485a5b0ba07d8cf400a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d49467b-d34c-47d0-96de-f21634d04c69),volume_type_id=6d49467b-d34c-47d0-96de-f21634d04c69)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50870d7a-77fc-4754-b457-9378e82242a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50870d7a-77fc-4754-b457-9378e82242a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f681005f-e832-4d54-9d5d-9ff67fdf7c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f681005f-e832-4d54-9d5d-9ff67fdf7c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197c2428-6f9f-4d57-bd58-6f8e4738b585', 'volume_name': 'volume-197c2428-6f9f-4d57-bd58-6f8e4738b585', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d5c44e-8ac8-48e4-b335-c32deda35b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d5c44e-8ac8-48e4-b335-c32deda35b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a03c93-7570-4014-adaf-c80a07c6a0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:42 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Volume 197c2428-6f9f-4d57-bd58-6f8e4738b585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197c2428-6f9f-4d57-bd58-6f8e4738b585', 'volume_size': 1} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:42 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b.82b8d762-be0e-4f36-821e-6f2a922149e7" returned: 0 in 0.311s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "cinder-quobyte-82b8d762-be0e-4f36-821e-6f2a922149e7" released by "_delete_snapshot" :: held 2.184s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "cinder-quobyte-4e448963-eb70-4e05-8eea-86864b78651b" released by "delete_snapshot" :: held 2.259s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.quota [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Created reservations ['b5221218-fc2d-40cb-8829-ad24180f8205', '5ec5f9fe-2ac2-44ed-a3e7-a0a4d1112e63', 'a76f99d4-a3f3-44e7-9537-a55a09f3e50f', 'fc80e93a-8f09-44c7-92f2-02c5951a28ab'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:41:42 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9 1073741824" returned: 0 in 0.825s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:42 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Delete snapshot completed successfully. Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-3f1eca34-ba0b-4017-a50b-f54a5754f503 req-82777864-926a-46ee-b07f-0b11ebfe7674 tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "cinder-82b8d762-be0e-4f36-821e-6f2a922149e7-delete_snapshot" released by "delete_snapshot" :: held 2.490s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:42 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9 Sep 21 16:41:42 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Acquiring lock "cinder-4e448963-eb70-4e05-8eea-86864b78651b-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "cinder-4e448963-eb70-4e05-8eea-86864b78651b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Acquiring lock "cinder-quobyte-4e448963-eb70-4e05-8eea-86864b78651b" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "cinder-quobyte-4e448963-eb70-4e05-8eea-86864b78651b" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:43 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07cd8f3-c012-4e10-a779-0c25f5d10a0f]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9" returned: 0 in 0.390s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.859s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-728959972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197c2428-6f9f-4d57-bd58-6f8e4738b585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6729dfac7394ed39b9723b2077a20f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:42Z,use_quota=True,user_id='ae6499e85a534485a5b0ba07d8cf400a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d49467b-d34c-47d0-96de-f21634d04c69),volume_type_id=6d49467b-d34c-47d0-96de-f21634d04c69)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Creating volume 197c2428-6f9f-4d57-bd58-6f8e4738b585 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:41:43 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-197c2428-6f9f-4d57-bd58-6f8e4738b585 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Flow 'volume_create_manager' (609070d2-8741-4c37-9af7-a0c282f37d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26270b7e-166b-4f1f-b254-01c85f222a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:43 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-197c2428-6f9f-4d57-bd58-6f8e4738b585 1073741824 Sep 21 16:41:43 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279037f1-edb5-457a-819a-2acc99b0949d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fadffe-4f34-4750-a703-63440cba10e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26270b7e-166b-4f1f-b254-01c85f222a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-670474710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ac8b71-c469-4aea-a9c8-53f83c8a9610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6729dfac7394ed39b9723b2077a20f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:43Z,use_quota=True,user_id='ae6499e85a534485a5b0ba07d8cf400a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffffb090-f714-4994-86a2-67d4e1052ea8),volume_type_id=ffffb090-f714-4994-86a2-67d4e1052ea8)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048a11a9-2b97-4968-b6c6-9cc085f900c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048a11a9-2b97-4968-b6c6-9cc085f900c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22837b2-62f7-40d2-bb63-e32fd996c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.image.glance [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Creating Keystone auth plugin from conf {{(pid=86030) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 16:41:43 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b Sep 21 16:41:43 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:43 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Volume volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9 (0f0eb0a3-38f8-4696-81b6-75ed00cd88a9): created successfully Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fadffe-4f34-4750-a703-63440cba10e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Flow 'volume_create_manager' (4c839032-9636-4363-89b0-e41485aad4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d0cf2cad-dfff-49e1-9ff4-85cf3c529a60 tempest-TestInstancesWithCinderVolumes-1956270381 None] Created volume successfully. Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Acquiring lock "cinder-bf03ce08-abc6-40f8-809b-7d585544c187-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Lock "cinder-bf03ce08-abc6-40f8-809b-7d585544c187-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Acquiring lock "cinder-quobyte-bf03ce08-abc6-40f8-809b-7d585544c187" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-357d5f1e-12b6-4a89-9087-0cc7432e9056 tempest-GroupsV314Test-334218460 None] Group tempest-GroupsV314Test-Group-2002550470: creating Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Lock "cinder-quobyte-bf03ce08-abc6-40f8-809b-7d585544c187" acquired by "delete_volume" :: waited 0.033s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca13f9e-c082-4b87-8cc3-f0d02b93e10b]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bf03ce08-abc6-40f8-809b-7d585544c187 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-357d5f1e-12b6-4a89-9087-0cc7432e9056 tempest-GroupsV314Test-334218460 None] Group tempest-GroupsV314Test-Group-2002550470: created successfully Sep 21 16:41:43 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b" returned: 0 in 0.518s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-357d5f1e-12b6-4a89-9087-0cc7432e9056 tempest-GroupsV314Test-334218460 None] Create group completed successfully. Sep 21 16:41:43 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b Sep 21 16:41:43 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:43 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bf03ce08-abc6-40f8-809b-7d585544c187 Sep 21 16:41:43 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22837b2-62f7-40d2-bb63-e32fd996c430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02ac8b71-c469-4aea-a9c8-53f83c8a9610', 'volume_name': 'volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610', 'volume_size': 1, 'image_id': 'e4aada81-4d52-497c-ae3f-ba9353a117f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4aada81-4d52-497c-ae3f-ba9353a117f2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1413834821', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6729dfac7394ed39b9723b2077a20f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e4aada81-4d52-497c-ae3f-ba9353a117f2', 'created_at': datetime.datetime(2026, 9, 21, 14, 41, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 41, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4aada81-4d52-497c-ae3f-ba9353a117f2/file', 'properties': {}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44bebc5-97b5-4738-807f-c5228cb592e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44bebc5-97b5-4738-807f-c5228cb592e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:44 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf7086f-ad7a-4a7b-b6a1-9cafb715df34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:44 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Volume 02ac8b71-c469-4aea-a9c8-53f83c8a9610: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610', 'volume_size': 1, 'image_id': 'e4aada81-4d52-497c-ae3f-ba9353a117f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4aada81-4d52-497c-ae3f-ba9353a117f2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1413834821', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6729dfac7394ed39b9723b2077a20f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e4aada81-4d52-497c-ae3f-ba9353a117f2', 'created_at': datetime.datetime(2026, 9, 21, 14, 41, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 41, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4aada81-4d52-497c-ae3f-ba9353a117f2/file', 'properties': {}}, 'image_service': } Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Trying to clone 02ac8b71-c469-4aea-a9c8-53f83c8a9610 from image e4aada81-4d52-497c-ae3f-ba9353a117f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e4aada81-4d52-497c-ae3f-ba9353a117f2', 'metadata': {}}]). {{(pid=86030) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-197c2428-6f9f-4d57-bd58-6f8e4738b585 1073741824" returned: 0 in 0.662s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-197c2428-6f9f-4d57-bd58-6f8e4738b585 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:44 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-197c2428-6f9f-4d57-bd58-6f8e4738b585 Sep 21 16:41:44 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:44 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4e448963-eb70-4e05-8eea-86864b78651b" returned: 0 in 0.353s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "cinder-quobyte-4e448963-eb70-4e05-8eea-86864b78651b" released by "delete_volume" :: held 0.980s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:44 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bf03ce08-abc6-40f8-809b-7d585544c187" returned: 0 in 0.480s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bf03ce08-abc6-40f8-809b-7d585544c187 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:44 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bf03ce08-abc6-40f8-809b-7d585544c187 Sep 21 16:41:44 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.quota [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Created reservations ['85ee954b-a601-461d-a6c6-2d73681ebe52', '0750fd0e-699e-4e81-b551-43e4bc6ca722', '2460f92c-a350-4c00-957d-10dc2debc90a', '7b304bf5-9810-4f3b-a6ad-1e65fc64a7b8'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:44 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-197c2428-6f9f-4d57-bd58-6f8e4738b585" returned: 0 in 0.356s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:44 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:41:44 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a03c93-7570-4014-adaf-c80a07c6a0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197c2428-6f9f-4d57-bd58-6f8e4738b585', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f680f9-ecc9-4798-9a14-0f7bed76f55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:44 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Volume volume-197c2428-6f9f-4d57-bd58-6f8e4738b585 (197c2428-6f9f-4d57-bd58-6f8e4738b585): created successfully Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f680f9-ecc9-4798-9a14-0f7bed76f55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Flow 'volume_create_manager' (16dd368c-653f-4776-a644-6ef74f73f2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:44 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d5e593fa-4594-4d5e-bf09-4213b330df96 tempest-TestInstancesWithCinderVolumes-1956270381 None] Created volume successfully. Sep 21 16:41:44 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bf03ce08-abc6-40f8-809b-7d585544c187" returned: 0 in 0.305s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Lock "cinder-quobyte-bf03ce08-abc6-40f8-809b-7d585544c187" released by "delete_volume" :: held 0.834s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Created reservations ['bbb96075-a565-40a3-a02f-70cef90ea4ee', '0fa68f3c-a2f6-4b23-a29c-11fbb00ee99f', '75cdbf4a-d067-43c8-9ef3-2d6d118e26bd', '6cbd0cb3-53e9-4878-8562-203777d06fb1'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:41:44 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.329s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.manager [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:44 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Deleted volume successfully. Sep 21 16:41:44 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:41:44 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-9f6c4331-6dfb-49e3-b910-b6e75374eed1 req-ccc8f3ac-a829-4db4-9536-e451e5161acf tempest-VolumesSnapshotsTestJSON-919266857 None] Lock "cinder-4e448963-eb70-4e05-8eea-86864b78651b-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:45 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.368s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:41:45 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Deleted volume successfully. Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-00263913-7d3b-4508-ae66-f21b8b5fbe57 tempest-VolumesTransfersTest-1071911690 None] Lock "cinder-bf03ce08-abc6-40f8-809b-7d585544c187-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Flow 'volume_create_manager' (95e60baf-c7de-4451-bea6-b6ef410c0575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f766bd3-45b0-459d-9076-0b920f0c0991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f766bd3-45b0-459d-9076-0b920f0c0991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1420330657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31fb1c6b-3e41-4347-b82c-2791a6312dcb,host='devstack@QuobyteHD#QuobyteHD',id=02a518a0-9f7e-40bc-b68c-9e3fd6622096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6f05a0e12344f3b7d8e80f61fde266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:45Z,use_quota=True,user_id='5513aeaf9a594a8da90bc3483f8ee79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f999fc8-19bc-43a1-bab6-3e0e9e072310),volume_type_id=0f999fc8-19bc-43a1-bab6-3e0e9e072310)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbca0fdb-5fb3-464a-ad00-04547555e1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbca0fdb-5fb3-464a-ad00-04547555e1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f98e623-4307-44c2-80e7-ab9ef0e3fed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f98e623-4307-44c2-80e7-ab9ef0e3fed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a518a0-9f7e-40bc-b68c-9e3fd6622096', 'volume_name': 'volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b8a2da-8e2f-4cce-a381-0b46fae0bae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b8a2da-8e2f-4cce-a381-0b46fae0bae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55160b4-bb41-4015-8f4e-14ca77de4348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:45 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Volume 02a518a0-9f7e-40bc-b68c-9e3fd6622096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096', 'volume_size': 1} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=31fb1c6b-3e41-4347-b82c-2791a6312dcb,created_at=2026-09-21T14:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1420330657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31fb1c6b-3e41-4347-b82c-2791a6312dcb,host='devstack@QuobyteHD#QuobyteHD',id=02a518a0-9f7e-40bc-b68c-9e3fd6622096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6f05a0e12344f3b7d8e80f61fde266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:45Z,use_quota=True,user_id='5513aeaf9a594a8da90bc3483f8ee79e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f999fc8-19bc-43a1-bab6-3e0e9e072310),volume_type_id=0f999fc8-19bc-43a1-bab6-3e0e9e072310)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Creating volume 02a518a0-9f7e-40bc-b68c-9e3fd6622096 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:41:45 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:41:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:45 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 1073741824 Sep 21 16:41:45 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:46 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 1073741824" returned: 0 in 0.614s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:46 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 Sep 21 16:41:46 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:46 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096" returned: 0 in 0.355s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:41:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55160b4-bb41-4015-8f4e-14ca77de4348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06d3bbc-70b5-46e2-b4b2-640757c6fff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:46 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Volume volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 (02a518a0-9f7e-40bc-b68c-9e3fd6622096): created successfully Sep 21 16:41:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06d3bbc-70b5-46e2-b4b2-640757c6fff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Flow 'volume_create_manager' (95e60baf-c7de-4451-bea6-b6ef410c0575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ed76daf4-1700-4a2b-a455-c95e914985bf tempest-GroupsV314Test-334218460 None] Created volume successfully. Sep 21 16:41:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:48 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Cloning volume 02a518a0-9f7e-40bc-b68c-9e3fd6622096 to volume 8e3fdeda-4aaf-4500-811f-1ef825c8b097 Sep 21 16:41:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Creating offline snapshot dd59a99d-1af3-4abf-a829-2103644abcc7 of volume 02a518a0-9f7e-40bc-b68c-9e3fd6622096 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:41:48 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[223f1e62-899a-403e-8302-beb6e26d4ab0]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:49 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 Sep 21 16:41:49 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD, size 20.69 MB, duration 5.33 sec {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 16:41:49 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Image download 20.69 MB at 3.88 MB/s Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edee73d-869f-4663-9c10-7d098f0540b4]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:49 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096" returned: 0 in 0.623s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:49 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD Sep 21 16:41:49 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:49 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 1G Sep 21 16:41:49 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:49 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Temporary image e4aada81-4d52-497c-ae3f-ba9353a117f2 is fetched for user ae6499e85a534485a5b0ba07d8cf400a. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Flow 'volume_create_manager' (77caedb1-22f2-4014-b662-27a250788c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a161c7f-c237-457d-9d78-658196316894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a161c7f-c237-457d-9d78-658196316894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-151618082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f781611b-4c9e-4425-93af-66a470d01220,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14385f74906d4436a800af9467ec4139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:50Z,use_quota=True,user_id='4f45f0f1597744bda5b6dea981d66fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9429047e-6610-4e00-ae2c-94670c41a15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9429047e-6610-4e00-ae2c-94670c41a15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8e653c-586d-4415-9cc7-72979947f8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8e653c-586d-4415-9cc7-72979947f8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f781611b-4c9e-4425-93af-66a470d01220', 'volume_name': 'volume-f781611b-4c9e-4425-93af-66a470d01220', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d9c694-963c-40ef-9c78-4d9ec9ddc826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d9c694-963c-40ef-9c78-4d9ec9ddc826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9493a3ca-0d88-4a9e-ab71-2bc9a31ca071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:49 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Volume f781611b-4c9e-4425-93af-66a470d01220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f781611b-4c9e-4425-93af-66a470d01220', 'volume_size': 1} Sep 21 16:41:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:50 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[223bcd9f-08db-44c3-8dff-684f019a4c73]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:50 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 1G" returned: 0 in 0.584s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:50 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 Sep 21 16:41:50 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:50 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD Sep 21 16:41:50 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:50 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:50 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7" returned: 0 in 0.329s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:50 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:41:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:50 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 Sep 21 16:41:50 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:50 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7" returned: 0 in 0.265s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:50 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.info Sep 21 16:41:50 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:51 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.info" returned: 0 in 0.264s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:51 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.info is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:51 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.info Sep 21 16:41:51 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:51 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.info" returned: 0 in 0.259s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Acquiring lock "cinder-quobyte-8e3fdeda-4aaf-4500-811f-1ef825c8b097" by "_copy_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Lock "cinder-quobyte-8e3fdeda-4aaf-4500-811f-1ef825c8b097" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] snapshot: dd59a99d-1af3-4abf-a829-2103644abcc7, volume: 8e3fdeda-4aaf-4500-811f-1ef825c8b097, {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[82af0f21-8b79-4a1b-ad1f-d2581f1c6d17]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:51 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 Sep 21 16:41:51 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:51 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7" returned: 0 in 0.390s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3baeab-c3c9-493b-b831-1f580ac38338]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:51 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 Sep 21 16:41:51 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:52 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096" returned: 0 in 0.403s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 16:41:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Creating direct copy from snapshot {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 16:41:52 devstack cinder-volume[86030]: DEBUG cinder.utils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Path /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097 not found in is_blk_device check {{(pid=86030) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 21 16:41:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:52 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097 Sep 21 16:41:52 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:53 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:41:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Flow 'volume_create_manager' (f7096cec-f057-4fa3-8011-86b2679a4588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:41:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4667af-9fb8-4f1d-afd1-20cc75663ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4667af-9fb8-4f1d-afd1-20cc75663ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-447346589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192a02d3-2f44-40e4-b0a9-1f62c891ce1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='617a698557ba4db3be136b192c2073da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:53Z,use_quota=True,user_id='d0b6b924f4e14648ae015062e240dfb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98a526d-40a0-4db7-a1b2-faa1e50025c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98a526d-40a0-4db7-a1b2-faa1e50025c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eecf8bc-725a-4709-92d7-549d4ef7a714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eecf8bc-725a-4709-92d7-549d4ef7a714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192a02d3-2f44-40e4-b0a9-1f62c891ce1b', 'volume_name': 'volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6d1a62-2ac4-416b-927d-9cb67490ce72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6d1a62-2ac4-416b-927d-9cb67490ce72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:41:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f95664-cb49-43b3-bdd9-6d900c68b736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:41:53 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Volume 192a02d3-2f44-40e4-b0a9-1f62c891ce1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b', 'volume_size': 1} Sep 21 16:41:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:41:58 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097" returned: 0 in 6.350s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:58 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097 {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:41:58 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Converted 1024.00 MB image at 161.24 MB/s Sep 21 16:41:58 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097 is being set with open permissions: ugo+rw: NotImplementedError Sep 21 16:41:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:58 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097 Sep 21 16:41:58 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:58 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097" returned: 0 in 0.243s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:58 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Lock "cinder-quobyte-8e3fdeda-4aaf-4500-811f-1ef825c8b097" released by "_copy_volume_from_snapshot" :: held 7.457s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:41:58 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Acquiring lock "cinder-quobyte-dd59a99d-1af3-4abf-a829-2103644abcc7" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:41:58 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Lock "cinder-quobyte-dd59a99d-1af3-4abf-a829-2103644abcc7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:41:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Deleting offline snapshot dd59a99d-1af3-4abf-a829-2103644abcc7 of volume 02a518a0-9f7e-40bc-b68c-9e3fd6622096 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:41:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] snapshot_file for this snap is: volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:41:58 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a0a368-70f9-451b-8e20-504fc7c66948]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:58 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 Sep 21 16:41:58 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:59 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7" returned: 0 in 0.354s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:41:59 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e34df1-fde9-4990-998a-96a482e45544]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:41:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:59 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 Sep 21 16:41:59 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:41:59 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Sep 21 16:41:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096" returned: 0 in 0.497s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:41:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:41:59 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 Sep 21 16:41:59 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:00 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7" returned: 0 in 0.318s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:00 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7 Sep 21 16:42:00 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:00 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096.dd59a99d-1af3-4abf-a829-2103644abcc7" returned: 0 in 0.251s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Lock "cinder-quobyte-dd59a99d-1af3-4abf-a829-2103644abcc7" released by "_delete_snapshot" :: held 1.513s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.516s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.364s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-151618082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f781611b-4c9e-4425-93af-66a470d01220,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14385f74906d4436a800af9467ec4139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:50Z,use_quota=True,user_id='4f45f0f1597744bda5b6dea981d66fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Creating volume f781611b-4c9e-4425-93af-66a470d01220 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:42:00 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f781611b-4c9e-4425-93af-66a470d01220 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:00 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f781611b-4c9e-4425-93af-66a470d01220 1073741824 Sep 21 16:42:00 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:00 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8825e241-1ada-49eb-8384-22cb1635c226 tempest-GroupsV314Test-334218460 None] Create group from source-group-31fb1c6b-3e41-4347-b82c-2791a6312dcb completed successfully. Sep 21 16:42:00 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f781611b-4c9e-4425-93af-66a470d01220 1073741824" returned: 0 in 0.451s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f781611b-4c9e-4425-93af-66a470d01220 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:00 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f781611b-4c9e-4425-93af-66a470d01220 Sep 21 16:42:00 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:01 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f781611b-4c9e-4425-93af-66a470d01220" returned: 0 in 0.237s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.691s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-670474710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ac8b71-c469-4aea-a9c8-53f83c8a9610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6729dfac7394ed39b9723b2077a20f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:43Z,use_quota=True,user_id='ae6499e85a534485a5b0ba07d8cf400a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffffb090-f714-4994-86a2-67d4e1052ea8),volume_type_id=ffffb090-f714-4994-86a2-67d4e1052ea8)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Creating volume 02ac8b71-c469-4aea-a9c8-53f83c8a9610 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:42:01 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9493a3ca-0d88-4a9e-ab71-2bc9a31ca071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f781611b-4c9e-4425-93af-66a470d01220', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66decbcb-2b7e-4ee7-9581-02240e15f502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:01 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 1073741824 Sep 21 16:42:01 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:01 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Volume volume-f781611b-4c9e-4425-93af-66a470d01220 (f781611b-4c9e-4425-93af-66a470d01220): created successfully Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66decbcb-2b7e-4ee7-9581-02240e15f502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Flow 'volume_create_manager' (77caedb1-22f2-4014-b662-27a250788c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:01 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ee4b9e1e-a846-4cf1-b10b-180795bcfb16 tempest-VolumesTestJSON-452168725 None] Created volume successfully. Sep 21 16:42:01 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 1073741824" returned: 0 in 0.420s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:01 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 Sep 21 16:42:01 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:01 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610" returned: 0 in 0.297s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.498s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-447346589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192a02d3-2f44-40e4-b0a9-1f62c891ce1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='617a698557ba4db3be136b192c2073da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:41:53Z,use_quota=True,user_id='d0b6b924f4e14648ae015062e240dfb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Creating volume 192a02d3-2f44-40e4-b0a9-1f62c891ce1b {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:42:01 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:01 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b 1073741824 Sep 21 16:42:01 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Attempting download of e4aada81-4d52-497c-ae3f-ba9353a117f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/e4aada81-4d52-497c-ae3f-ba9353a117f2', 'metadata': {}}])) to volume 02ac8b71-c469-4aea-a9c8-53f83c8a9610. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[5744ced4-e256-4ad6-aa90-62096ed22533]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:42:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4aada81-4d52-497c-ae3f-ba9353a117f2_nkoz3j8a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Acquiring lock "cinder-quobyte-8e3fdeda-4aaf-4500-811f-1ef825c8b097" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Lock "cinder-quobyte-8e3fdeda-4aaf-4500-811f-1ef825c8b097" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[033cfe5c-393f-406d-9097-234a4ba4eeb5]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:02 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4aada81-4d52-497c-ae3f-ba9353a117f2_nkoz3j8a Sep 21 16:42:02 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:02 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097 Sep 21 16:42:02 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Flow 'volume_create_manager' (7c1902a3-ff6b-4142-9e4f-219191ec8398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:02 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebd0b87-89c4-4def-a041-c5625d1c5707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4aada81-4d52-497c-ae3f-ba9353a117f2_nkoz3j8a" returned: 0 in 0.497s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:02 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4aada81-4d52-497c-ae3f-ba9353a117f2_nkoz3j8a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b 1073741824" returned: 0 in 0.635s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebd0b87-89c4-4def-a041-c5625d1c5707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1743768418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da2e8b9-9f19-467a-8b4e-72fc434b2a15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14385f74906d4436a800af9467ec4139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:02Z,use_quota=True,user_id='4f45f0f1597744bda5b6dea981d66fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c317c35-3803-471d-8da8-eee6bf50e96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c317c35-3803-471d-8da8-eee6bf50e96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea98973-7f8c-4cb7-ab62-a6518fd72f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea98973-7f8c-4cb7-ab62-a6518fd72f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da2e8b9-9f19-467a-8b4e-72fc434b2a15', 'volume_name': 'volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f373bbb7-f894-4a7a-a80c-e743e94e242f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f373bbb7-f894-4a7a-a80c-e743e94e242f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbb4f38-1d28-4c13-bf32-de72aa9c8a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:02 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Volume 2da2e8b9-9f19-467a-8b4e-72fc434b2a15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15', 'volume_size': 1} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:02 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097" returned: 0 in 0.485s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:02 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4aada81-4d52-497c-ae3f-ba9353a117f2_nkoz3j8a Sep 21 16:42:02 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:02 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b Sep 21 16:42:02 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:02 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097 Sep 21 16:42:02 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:02 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4aada81-4d52-497c-ae3f-ba9353a117f2_nkoz3j8a" returned: 1 in 0.388s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4aada81-4d52-497c-ae3f-ba9353a117f2_nkoz3j8a' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2961665-f609-45bd-ae1a-417be1182319]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:02 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:02 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8e3fdeda-4aaf-4500-811f-1ef825c8b097" returned: 0 in 0.289s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b" returned: 0 in 0.321s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Lock "cinder-quobyte-8e3fdeda-4aaf-4500-811f-1ef825c8b097" released by "delete_volume" :: held 0.879s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.366s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1743768418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da2e8b9-9f19-467a-8b4e-72fc434b2a15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14385f74906d4436a800af9467ec4139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:02Z,use_quota=True,user_id='4f45f0f1597744bda5b6dea981d66fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Creating volume 2da2e8b9-9f19-467a-8b4e-72fc434b2a15 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:42:02 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:02 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15 1073741824 Sep 21 16:42:02 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f95664-cb49-43b3-bdd9-6d900c68b736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79643759-72cc-4a91-a7c0-2a2aa0bdf64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:02 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Volume volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b (192a02d3-2f44-40e4-b0a9-1f62c891ce1b): created successfully Sep 21 16:42:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79643759-72cc-4a91-a7c0-2a2aa0bdf64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Flow 'volume_create_manager' (f7096cec-f057-4fa3-8011-86b2679a4588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:03 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD Sep 21 16:42:03 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-7204bd82-f143-4360-8b7e-c2dce5ed6ccb tempest-VolumesListTestJSON-1562104508 None] Created volume successfully. Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Created reservations ['42f3a884-43ba-4701-b71c-399605f48d70'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:03 devstack cinder-volume[86030]: WARNING cinder.quota [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-575074551 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-575074551, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:42:03 devstack cinder-volume[86030]: WARNING cinder.quota [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-575074551 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-575074551, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Created reservations ['f88b329e-f415-4d6e-8091-195209db2a7a', '48e84904-f51f-48b4-be27-b2d59d29c054', 'de6aa300-ef12-4ce8-9c69-5f7af8e3145a', '1fb40e3a-b5f3-4bae-adae-6345f4a915e2'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:03 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:03 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:42:03 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] e4aada81-4d52-497c-ae3f-ba9353a117f2 was qcow2, converting to qcow2 {{(pid=86030) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:03 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 Sep 21 16:42:03 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:03 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15 1073741824" returned: 0 in 0.525s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:03 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.284s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:42:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fd8fb6b2-6484-4753-878a-caef35f652f5 tempest-GroupsV314Test-334218460 None] Delete group completed successfully. Sep 21 16:42:03 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15 Sep 21 16:42:03 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:03 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15" returned: 0 in 0.257s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbb4f38-1d28-4c13-bf32-de72aa9c8a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b14ec0-f91f-47c5-8f9f-aaab6e4cd810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:03 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Volume volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15 (2da2e8b9-9f19-467a-8b4e-72fc434b2a15): created successfully Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b14ec0-f91f-47c5-8f9f-aaab6e4cd810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Flow 'volume_create_manager' (7c1902a3-ff6b-4142-9e4f-219191ec8398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b7b6ac71-a317-4c1f-831d-3887454b1f06 tempest-VolumesTestJSON-452168725 None] Created volume successfully. Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Acquiring lock "cinder-quobyte-02a518a0-9f7e-40bc-b68c-9e3fd6622096" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Flow 'volume_create_manager' (15d8921c-b45e-4437-90a0-1267c0506b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed47d7b-e528-4b58-922b-252f6ac8bc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Lock "cinder-quobyte-02a518a0-9f7e-40bc-b68c-9e3fd6622096" acquired by "delete_volume" :: waited 0.095s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed47d7b-e528-4b58-922b-252f6ac8bc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1553117680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec6af9f-c550-4951-9f36-6f1c611be24f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='617a698557ba4db3be136b192c2073da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:05Z,use_quota=True,user_id='d0b6b924f4e14648ae015062e240dfb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e17c2e-e1cc-421e-90c8-3540ef186700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e17c2e-e1cc-421e-90c8-3540ef186700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8007fd4-1557-4b4d-ab80-ad3c900098a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8007fd4-1557-4b4d-ab80-ad3c900098a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ec6af9f-c550-4951-9f36-6f1c611be24f', 'volume_name': 'volume-3ec6af9f-c550-4951-9f36-6f1c611be24f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d426723-69b4-4c8f-be63-79ddd57d4e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d426723-69b4-4c8f-be63-79ddd57d4e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f40768-207a-4fd4-9449-2034670032fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:04 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Volume 3ec6af9f-c550-4951-9f36-6f1c611be24f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ec6af9f-c550-4951-9f36-6f1c611be24f', 'volume_size': 1} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1553117680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec6af9f-c550-4951-9f36-6f1c611be24f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='617a698557ba4db3be136b192c2073da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:05Z,use_quota=True,user_id='d0b6b924f4e14648ae015062e240dfb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Creating volume 3ec6af9f-c550-4951-9f36-6f1c611be24f {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:42:04 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ec6af9f-c550-4951-9f36-6f1c611be24f 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4d19f2-0f77-47f2-90ef-2c2e593d04a4]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:42:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:04 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ec6af9f-c550-4951-9f36-6f1c611be24f 1073741824 Sep 21 16:42:04 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:05 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 Sep 21 16:42:05 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:05 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096" returned: 0 in 0.525s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:42:05 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096 Sep 21 16:42:05 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Flow 'volume_create_manager' (b60cf66e-d450-4040-af8e-c63147638890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dddd485-d8fe-4ba6-8526-3a8b363f9bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dddd485-d8fe-4ba6-8526-3a8b363f9bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1641554136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa574a24-bfe9-41a4-a848-064527b7affe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14385f74906d4436a800af9467ec4139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:05Z,use_quota=True,user_id='4f45f0f1597744bda5b6dea981d66fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b8b79b-74a9-4b16-9afc-83afab6a9394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b8b79b-74a9-4b16-9afc-83afab6a9394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2479936f-f5a8-46ad-bd17-10a8d2bbc962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:05 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2479936f-f5a8-46ad-bd17-10a8d2bbc962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa574a24-bfe9-41a4-a848-064527b7affe', 'volume_name': 'volume-fa574a24-bfe9-41a4-a848-064527b7affe', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275d13b9-6d63-423a-9e0b-62edee25a56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275d13b9-6d63-423a-9e0b-62edee25a56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a159a5-9064-4df6-b783-c897ebdc00da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:05 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Volume fa574a24-bfe9-41a4-a848-064527b7affe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa574a24-bfe9-41a4-a848-064527b7affe', 'volume_size': 1} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ec6af9f-c550-4951-9f36-6f1c611be24f 1073741824" returned: 0 in 0.738s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ec6af9f-c550-4951-9f36-6f1c611be24f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:05 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610" returned: 0 in 2.386s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e4aada81-4d52-497c-ae3f-ba9353a117f2_ndvicw13devstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:42:05 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Converted 112.00 MB image at 46.89 MB/s Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:05 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ec6af9f-c550-4951-9f36-6f1c611be24f Sep 21 16:42:05 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:05 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 1G Sep 21 16:42:05 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:05 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02a518a0-9f7e-40bc-b68c-9e3fd6622096" returned: 0 in 0.308s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Lock "cinder-quobyte-02a518a0-9f7e-40bc-b68c-9e3fd6622096" released by "delete_volume" :: held 0.993s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Created reservations ['1d822388-ce4b-4b27-935e-633568456333'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Created reservations ['ce3a52e3-22dd-4b35-9c18-92dcfcc4c87b', 'e9271735-7e92-409c-a1f8-bf54cc69f85c', '7495e8a7-4e44-4897-919e-8e36b8844616', '677b7cd4-367c-4573-a57a-c9b173b68b3e'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:05 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ec6af9f-c550-4951-9f36-6f1c611be24f" returned: 0 in 0.294s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.341s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1641554136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa574a24-bfe9-41a4-a848-064527b7affe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14385f74906d4436a800af9467ec4139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:05Z,use_quota=True,user_id='4f45f0f1597744bda5b6dea981d66fc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Creating volume fa574a24-bfe9-41a4-a848-064527b7affe {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:42:05 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:42:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa574a24-bfe9-41a4-a848-064527b7affe 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f40768-207a-4fd4-9449-2034670032fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec6af9f-c550-4951-9f36-6f1c611be24f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9751c48b-5aaa-433e-bd80-e62c100fa772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:06 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa574a24-bfe9-41a4-a848-064527b7affe 1073741824 Sep 21 16:42:06 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:06 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Volume volume-3ec6af9f-c550-4951-9f36-6f1c611be24f (3ec6af9f-c550-4951-9f36-6f1c611be24f): created successfully Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9751c48b-5aaa-433e-bd80-e62c100fa772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Flow 'volume_create_manager' (15d8921c-b45e-4437-90a0-1267c0506b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-1896bd55-bddf-4d4b-87a8-4e51bd5fd0aa tempest-VolumesListTestJSON-1562104508 None] Created volume successfully. Sep 21 16:42:06 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 1G" returned: 0 in 0.398s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Downloaded image e4aada81-4d52-497c-ae3f-ba9353a117f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/e4aada81-4d52-497c-ae3f-ba9353a117f2', 'metadata': {}}])) to volume 02ac8b71-c469-4aea-a9c8-53f83c8a9610 successfully. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Temporary image e4aada81-4d52-497c-ae3f-ba9353a117f2 for user ae6499e85a534485a5b0ba07d8cf400a is deleted. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Marking volume 02ac8b71-c469-4aea-a9c8-53f83c8a9610 as bootable. {{(pid=86030) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Copying metadata from image e4aada81-4d52-497c-ae3f-ba9353a117f2 to 02ac8b71-c469-4aea-a9c8-53f83c8a9610. {{(pid=86030) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Creating volume glance metadata for volume 02ac8b71-c469-4aea-a9c8-53f83c8a9610 backed by image e4aada81-4d52-497c-ae3f-ba9353a117f2 with: {'image_id': 'e4aada81-4d52-497c-ae3f-ba9353a117f2', 'image_name': 'tempest-scenario-img--1413834821', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86030) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 16:42:06 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:42:06 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf7086f-ad7a-4a7b-b6a1-9cafb715df34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610', 'volume_size': 1, 'image_id': 'e4aada81-4d52-497c-ae3f-ba9353a117f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4aada81-4d52-497c-ae3f-ba9353a117f2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1413834821', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6729dfac7394ed39b9723b2077a20f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e4aada81-4d52-497c-ae3f-ba9353a117f2', 'created_at': datetime.datetime(2026, 9, 21, 14, 41, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 41, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4aada81-4d52-497c-ae3f-ba9353a117f2/file', 'properties': {}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2ec279-9442-4e2d-ada1-806d2edbce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:06 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Volume volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 (02ac8b71-c469-4aea-a9c8-53f83c8a9610): created successfully Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2ec279-9442-4e2d-ada1-806d2edbce3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Flow 'volume_create_manager' (609070d2-8741-4c37-9af7-a0c282f37d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a5c27f9f-de9f-48db-a29b-e9b0f612d708 tempest-TestInstancesWithCinderVolumes-1956270381 None] Created volume successfully. Sep 21 16:42:06 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.369s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:42:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-27e0c301-f624-4f0c-83ba-171cbf5beff2 tempest-GroupsV314Test-334218460 None] Delete group completed successfully. Sep 21 16:42:06 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa574a24-bfe9-41a4-a848-064527b7affe 1073741824" returned: 0 in 0.545s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa574a24-bfe9-41a4-a848-064527b7affe {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:06 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa574a24-bfe9-41a4-a848-064527b7affe Sep 21 16:42:06 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:06 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa574a24-bfe9-41a4-a848-064527b7affe" returned: 0 in 0.274s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a159a5-9064-4df6-b783-c897ebdc00da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa574a24-bfe9-41a4-a848-064527b7affe', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b1559a-3729-47a2-a434-705b1def936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:06 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Volume volume-fa574a24-bfe9-41a4-a848-064527b7affe (fa574a24-bfe9-41a4-a848-064527b7affe): created successfully Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b1559a-3729-47a2-a434-705b1def936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Flow 'volume_create_manager' (b60cf66e-d450-4040-af8e-c63147638890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-20da122a-e880-444f-aa43-6e55c36b46f8 tempest-VolumesTestJSON-452168725 None] Created volume successfully. Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Flow 'volume_create_manager' (d26cff6d-6188-408d-aa77-32d215a3ee25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbc35a1-ab94-4164-b616-a919444ff23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbc35a1-ab94-4164-b616-a919444ff23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1430670796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0f9de1-f218-4fb7-97fe-14281f828cc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='617a698557ba4db3be136b192c2073da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:07Z,use_quota=True,user_id='d0b6b924f4e14648ae015062e240dfb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f508b6b8-372f-433d-b54e-36103080f588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f508b6b8-372f-433d-b54e-36103080f588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947f9c97-b740-4b35-824d-ed175bc3eaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947f9c97-b740-4b35-824d-ed175bc3eaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0f9de1-f218-4fb7-97fe-14281f828cc1', 'volume_name': 'volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800610e0-fd35-44a3-91e6-f4baddfc96dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800610e0-fd35-44a3-91e6-f4baddfc96dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88df3cf7-d10d-47c2-aed8-431ad0540378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:07 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Volume bd0f9de1-f218-4fb7-97fe-14281f828cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1', 'volume_size': 1} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1430670796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0f9de1-f218-4fb7-97fe-14281f828cc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='617a698557ba4db3be136b192c2073da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:07Z,use_quota=True,user_id='d0b6b924f4e14648ae015062e240dfb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Creating volume bd0f9de1-f218-4fb7-97fe-14281f828cc1 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:42:07 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:07 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1 1073741824 Sep 21 16:42:07 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:07 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:42:07 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:08 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1 1073741824" returned: 0 in 0.645s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:08 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1 Sep 21 16:42:08 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:08 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.424s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 28 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:42:08 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1" returned: 0 in 0.403s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88df3cf7-d10d-47c2-aed8-431ad0540378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf0f97a-9a84-4823-b0a5-b0a4d57ae39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:08 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Volume volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1 (bd0f9de1-f218-4fb7-97fe-14281f828cc1): created successfully Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf0f97a-9a84-4823-b0a5-b0a4d57ae39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Flow 'volume_create_manager' (d26cff6d-6188-408d-aa77-32d215a3ee25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:08 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-7bfcba3c-ec96-4f2c-b26f-b8b63624fd9e tempest-VolumesListTestJSON-1562104508 None] Created volume successfully. Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Acquiring lock "cinder-fa574a24-bfe9-41a4-a848-064527b7affe-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Lock "cinder-fa574a24-bfe9-41a4-a848-064527b7affe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Acquiring lock "cinder-quobyte-fa574a24-bfe9-41a4-a848-064527b7affe" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Lock "cinder-quobyte-fa574a24-bfe9-41a4-a848-064527b7affe" acquired by "delete_volume" :: waited 0.038s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:09 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a29ab70-c543-44e6-b8fe-ef8d2c120a79]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:42:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa574a24-bfe9-41a4-a848-064527b7affe {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:09 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa574a24-bfe9-41a4-a848-064527b7affe Sep 21 16:42:09 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:09 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa574a24-bfe9-41a4-a848-064527b7affe" returned: 0 in 0.528s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa574a24-bfe9-41a4-a848-064527b7affe {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:09 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa574a24-bfe9-41a4-a848-064527b7affe Sep 21 16:42:09 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:09 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fa574a24-bfe9-41a4-a848-064527b7affe" returned: 0 in 0.364s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Lock "cinder-quobyte-fa574a24-bfe9-41a4-a848-064527b7affe" released by "delete_volume" :: held 0.970s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:10 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Created reservations ['79710e7d-fea1-4fd3-a52b-827d7977d4bb', '9b202276-868f-442a-ba99-018d6bbba336', '8b110205-e8df-412d-8d56-1f9efc99a658', 'd89496b7-997b-4f04-8a1d-b2d87ee183cf'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:10 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:42:10 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:10 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.494s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:10 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:42:10 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Deleted volume successfully. Sep 21 16:42:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-72f09d62-4eb2-4760-b65f-68803ba63b04 tempest-VolumesTestJSON-452168725 None] Lock "cinder-fa574a24-bfe9-41a4-a848-064527b7affe-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-a0f8ef7c-bf82-45e8-a347-42de2cde7921 req-c3da6901-2af6-4a77-9761-6c56e6899157 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-a0f8ef7c-bf82-45e8-a347-42de2cde7921 req-c3da6901-2af6-4a77-9761-6c56e6899157 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-a0f8ef7c-bf82-45e8-a347-42de2cde7921 req-c3da6901-2af6-4a77-9761-6c56e6899157 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-a0f8ef7c-bf82-45e8-a347-42de2cde7921 req-c3da6901-2af6-4a77-9761-6c56e6899157 tempest-TestInstancesWithCinderVolumes-1956270381 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fd05974-96b8-4e98-9c16-d3357645ba16', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:42:11 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-a0f8ef7c-bf82-45e8-a347-42de2cde7921 req-c3da6901-2af6-4a77-9761-6c56e6899157 tempest-TestInstancesWithCinderVolumes-1956270381 None] attachment_update completed successfully. Sep 21 16:42:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Acquiring lock "cinder-2da2e8b9-9f19-467a-8b4e-72fc434b2a15-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Lock "cinder-2da2e8b9-9f19-467a-8b4e-72fc434b2a15-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Acquiring lock "cinder-quobyte-2da2e8b9-9f19-467a-8b4e-72fc434b2a15" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Lock "cinder-quobyte-2da2e8b9-9f19-467a-8b4e-72fc434b2a15" acquired by "delete_volume" :: waited 0.052s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:11 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[958ae215-8efc-4de9-b364-778481a0865e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:42:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:11 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15 Sep 21 16:42:11 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:12 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15" returned: 0 in 0.654s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:12 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15 Sep 21 16:42:12 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:12 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2da2e8b9-9f19-467a-8b4e-72fc434b2a15" returned: 0 in 0.293s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Lock "cinder-quobyte-2da2e8b9-9f19-467a-8b4e-72fc434b2a15" released by "delete_volume" :: held 1.032s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:12 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Created reservations ['02f7eb6c-7aff-4d06-a7b3-669301512011', 'fafb6911-b41a-4836-8d8a-d21c0a1e3f4f', '92ac5b76-130e-4412-b344-fb2d9f337859', 'eff25de1-6714-477a-9128-974bffea9ae0'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:12 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:42:12 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "cinder-bd0f9de1-f218-4fb7-97fe-14281f828cc1-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Lock "cinder-bd0f9de1-f218-4fb7-97fe-14281f828cc1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "cinder-quobyte-bd0f9de1-f218-4fb7-97fe-14281f828cc1" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Lock "cinder-quobyte-bd0f9de1-f218-4fb7-97fe-14281f828cc1" acquired by "delete_volume" :: waited 0.029s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff42fb79-a8ea-44e1-9cf4-1da162227e32]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:13 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.342s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:42:13 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Deleted volume successfully. Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8f57b30d-b97c-4c51-8bb7-30d45b68e7ec tempest-VolumesTestJSON-452168725 None] Lock "cinder-2da2e8b9-9f19-467a-8b4e-72fc434b2a15-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:13 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1 Sep 21 16:42:13 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:13 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1" returned: 0 in 0.544s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:13 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1 Sep 21 16:42:13 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Acquiring lock "cinder-f781611b-4c9e-4425-93af-66a470d01220-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Lock "cinder-f781611b-4c9e-4425-93af-66a470d01220-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Acquiring lock "cinder-quobyte-f781611b-4c9e-4425-93af-66a470d01220" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Lock "cinder-quobyte-f781611b-4c9e-4425-93af-66a470d01220" acquired by "delete_volume" :: waited 0.027s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd50750-8f03-4e79-837d-4eb39328882f]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:42:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f781611b-4c9e-4425-93af-66a470d01220 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:14 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f781611b-4c9e-4425-93af-66a470d01220 Sep 21 16:42:14 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:14 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd0f9de1-f218-4fb7-97fe-14281f828cc1" returned: 0 in 0.354s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Lock "cinder-quobyte-bd0f9de1-f218-4fb7-97fe-14281f828cc1" released by "delete_volume" :: held 0.967s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Created reservations ['423c2311-d7c1-40d2-ad39-db2efc150be0', '7960deed-d889-42c9-a497-a5f9203cdb70', '605def39-ea6d-4b0f-84ef-1c8c77642e69', '8cce60f3-7d61-45b1-a27a-57af134b6882'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:14 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f781611b-4c9e-4425-93af-66a470d01220" returned: 0 in 0.475s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f781611b-4c9e-4425-93af-66a470d01220 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:14 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:42:14 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:14 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f781611b-4c9e-4425-93af-66a470d01220 Sep 21 16:42:14 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:14 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.376s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:42:14 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Deleted volume successfully. Sep 21 16:42:14 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f781611b-4c9e-4425-93af-66a470d01220" returned: 0 in 0.406s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7d160403-ef30-40e7-bb8c-90a18021c14d tempest-VolumesListTestJSON-1562104508 None] Lock "cinder-bd0f9de1-f218-4fb7-97fe-14281f828cc1-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Lock "cinder-quobyte-f781611b-4c9e-4425-93af-66a470d01220" released by "delete_volume" :: held 0.954s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Created reservations ['3b598c67-97c3-4927-9d9d-f90556e2332c', '61c9fe19-9306-44eb-a389-1e3f4abe1b94', 'e74e34e0-3421-4be2-ac1c-88dce4a76af5', 'd2db99c4-4a00-45bf-a9b4-7b6d0f29f760'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:15 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:42:15 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "cinder-3ec6af9f-c550-4951-9f36-6f1c611be24f-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Lock "cinder-3ec6af9f-c550-4951-9f36-6f1c611be24f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:15 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.476s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "cinder-quobyte-3ec6af9f-c550-4951-9f36-6f1c611be24f" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:15 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Deleted volume successfully. Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Lock "cinder-quobyte-3ec6af9f-c550-4951-9f36-6f1c611be24f" acquired by "delete_volume" :: waited 0.053s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b5502aaa-a0be-4a17-85eb-98c7f6741c18 tempest-VolumesTestJSON-452168725 None] Lock "cinder-f781611b-4c9e-4425-93af-66a470d01220-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9616a4ec-5b51-4e93-9a7f-8aa75bf6550e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:42:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ec6af9f-c550-4951-9f36-6f1c611be24f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:16 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ec6af9f-c550-4951-9f36-6f1c611be24f Sep 21 16:42:16 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:16 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ec6af9f-c550-4951-9f36-6f1c611be24f" returned: 0 in 0.697s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ec6af9f-c550-4951-9f36-6f1c611be24f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:16 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ec6af9f-c550-4951-9f36-6f1c611be24f Sep 21 16:42:16 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:16 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fd75f82e-1a14-4f37-8c68-3cebf15cead9 tempest-GroupsV320Test-1829025205 None] Group tempest-GroupsV320Test-Group-1545538630: creating Sep 21 16:42:16 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fd75f82e-1a14-4f37-8c68-3cebf15cead9 tempest-GroupsV320Test-1829025205 None] Group tempest-GroupsV320Test-Group-1545538630: created successfully Sep 21 16:42:16 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fd75f82e-1a14-4f37-8c68-3cebf15cead9 tempest-GroupsV320Test-1829025205 None] Create group completed successfully. Sep 21 16:42:16 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3ec6af9f-c550-4951-9f36-6f1c611be24f" returned: 0 in 0.337s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:16 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Lock "cinder-quobyte-3ec6af9f-c550-4951-9f36-6f1c611be24f" released by "delete_volume" :: held 1.116s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:17 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Created reservations ['222c421c-c5e7-4917-b7e3-d0858fb1531d', 'e4d888bd-2d07-4a36-9570-dedeedcaa79f', 'e485291e-b8f8-4ba4-9a32-df050f2a5db8', 'fdeed9ac-3f63-40e3-99a6-770edf01a457'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:17 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:42:17 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:17 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.338s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:17 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:42:17 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Deleted volume successfully. Sep 21 16:42:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-568cfd6d-f604-4c1d-a52e-024be072b4a0 tempest-VolumesListTestJSON-1562104508 None] Lock "cinder-3ec6af9f-c550-4951-9f36-6f1c611be24f-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "cinder-192a02d3-2f44-40e4-b0a9-1f62c891ce1b-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Lock "cinder-192a02d3-2f44-40e4-b0a9-1f62c891ce1b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "cinder-quobyte-192a02d3-2f44-40e4-b0a9-1f62c891ce1b" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Lock "cinder-quobyte-192a02d3-2f44-40e4-b0a9-1f62c891ce1b" acquired by "delete_volume" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:18 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[696af8fd-de3f-4ead-8fd6-11916c0b48f6]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:42:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:18 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b Sep 21 16:42:18 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:18 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-e8f79ddd-ff36-407e-ae94-57a044cbd025 tempest-GroupsV320Test-1829025205 None] Created reservations ['736d0a31-4ef2-4a18-8c11-565e506198c3'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e8f79ddd-ff36-407e-ae94-57a044cbd025 tempest-GroupsV320Test-1829025205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e8f79ddd-ff36-407e-ae94-57a044cbd025 tempest-GroupsV320Test-1829025205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:18 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e8f79ddd-ff36-407e-ae94-57a044cbd025 tempest-GroupsV320Test-1829025205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:18 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e8f79ddd-ff36-407e-ae94-57a044cbd025 tempest-GroupsV320Test-1829025205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e8f79ddd-ff36-407e-ae94-57a044cbd025 tempest-GroupsV320Test-1829025205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e8f79ddd-ff36-407e-ae94-57a044cbd025 tempest-GroupsV320Test-1829025205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:18 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:42:18 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:19 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b" returned: 0 in 0.795s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:19 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b Sep 21 16:42:19 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:19 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e8f79ddd-ff36-407e-ae94-57a044cbd025 tempest-GroupsV320Test-1829025205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.488s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:19 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-e8f79ddd-ff36-407e-ae94-57a044cbd025 tempest-GroupsV320Test-1829025205 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:42:19 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e8f79ddd-ff36-407e-ae94-57a044cbd025 tempest-GroupsV320Test-1829025205 None] Delete group completed successfully. Sep 21 16:42:19 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-192a02d3-2f44-40e4-b0a9-1f62c891ce1b" returned: 0 in 0.457s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Lock "cinder-quobyte-192a02d3-2f44-40e4-b0a9-1f62c891ce1b" released by "delete_volume" :: held 1.346s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:19 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Created reservations ['89f71df9-ef92-4ff3-b588-70648e7efda7', '3f012217-b3e4-479d-977a-768f26da4fa9', 'c25b5277-da8d-4d89-956d-7de4b46f7d6e', '0e180672-de18-4613-b2f5-ef358294bb34'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:19 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:42:19 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:20 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.672s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:20 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:42:20 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Deleted volume successfully. Sep 21 16:42:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4fa0d151-f2df-4abb-afc8-8bcbf7d924bb tempest-VolumesListTestJSON-1562104508 None] Lock "cinder-192a02d3-2f44-40e4-b0a9-1f62c891ce1b-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:25 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6c28d3a0-d967-44b0-b0b1-59a8d5bc3c13 tempest-GroupsTest-559117188 None] Group tempest-Group1-488518852: creating Sep 21 16:42:25 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6c28d3a0-d967-44b0-b0b1-59a8d5bc3c13 tempest-GroupsTest-559117188 None] Group tempest-Group1-488518852: created successfully Sep 21 16:42:25 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6c28d3a0-d967-44b0-b0b1-59a8d5bc3c13 tempest-GroupsTest-559117188 None] Create group completed successfully. Sep 21 16:42:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0b0659f8-aa4d-4e1a-9fe4-a741e0de6fe6 tempest-GroupsTest-559117188 None] Group tempest-Group2-1521295165: creating Sep 21 16:42:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0b0659f8-aa4d-4e1a-9fe4-a741e0de6fe6 tempest-GroupsTest-559117188 None] Group tempest-Group2-1521295165: created successfully Sep 21 16:42:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0b0659f8-aa4d-4e1a-9fe4-a741e0de6fe6 tempest-GroupsTest-559117188 None] Create group completed successfully. Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Flow 'volume_create_manager' (696bd1ac-5508-4aa7-b045-8beaf362c24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f855685c-90f6-4dd9-b08e-422146e88bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f855685c-90f6-4dd9-b08e-422146e88bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-624371767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8bd7a17-bda1-4796-97b0-1f7603cf64ae,host='devstack@QuobyteHD#QuobyteHD',id=3614861a-cda9-44b2-ac95-c808dfc775b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86954126d7143cdb880b24a4dfa9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:29Z,use_quota=True,user_id='b179e46a0bf24cf49765424862ef8dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ef55412-ff82-41f7-9602-d6dc4fd7b3b8),volume_type_id=5ef55412-ff82-41f7-9602-d6dc4fd7b3b8)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22f6b0e-4971-4cc5-8c5f-325758a18584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b22f6b0e-4971-4cc5-8c5f-325758a18584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee1208c-6262-40d4-b13a-48411332ee20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee1208c-6262-40d4-b13a-48411332ee20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3614861a-cda9-44b2-ac95-c808dfc775b7', 'volume_name': 'volume-3614861a-cda9-44b2-ac95-c808dfc775b7', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d888ed-6755-49bc-b267-bebfa6420ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d888ed-6755-49bc-b267-bebfa6420ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a45b13-c980-4faa-a5ea-b2ea2c321369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:29 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Volume 3614861a-cda9-44b2-ac95-c808dfc775b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3614861a-cda9-44b2-ac95-c808dfc775b7', 'volume_size': 1} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b8bd7a17-bda1-4796-97b0-1f7603cf64ae,created_at=2026-09-21T14:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-624371767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8bd7a17-bda1-4796-97b0-1f7603cf64ae,host='devstack@QuobyteHD#QuobyteHD',id=3614861a-cda9-44b2-ac95-c808dfc775b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86954126d7143cdb880b24a4dfa9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:29Z,use_quota=True,user_id='b179e46a0bf24cf49765424862ef8dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ef55412-ff82-41f7-9602-d6dc4fd7b3b8),volume_type_id=5ef55412-ff82-41f7-9602-d6dc4fd7b3b8)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Creating volume 3614861a-cda9-44b2-ac95-c808dfc775b7 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:42:29 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:42:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3614861a-cda9-44b2-ac95-c808dfc775b7 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:29 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3614861a-cda9-44b2-ac95-c808dfc775b7 1073741824 Sep 21 16:42:29 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:30 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3614861a-cda9-44b2-ac95-c808dfc775b7 1073741824" returned: 0 in 0.818s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3614861a-cda9-44b2-ac95-c808dfc775b7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:30 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3614861a-cda9-44b2-ac95-c808dfc775b7 Sep 21 16:42:30 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:30 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3614861a-cda9-44b2-ac95-c808dfc775b7" returned: 0 in 0.523s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:42:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a45b13-c980-4faa-a5ea-b2ea2c321369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3614861a-cda9-44b2-ac95-c808dfc775b7', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48427e2a-eb15-48e3-a327-9a3b9c94c089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:30 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Volume volume-3614861a-cda9-44b2-ac95-c808dfc775b7 (3614861a-cda9-44b2-ac95-c808dfc775b7): created successfully Sep 21 16:42:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48427e2a-eb15-48e3-a327-9a3b9c94c089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Flow 'volume_create_manager' (696bd1ac-5508-4aa7-b045-8beaf362c24c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:30 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5e862a86-490f-4846-85fa-b23e975f8b62 tempest-GroupsTest-559117188 None] Created volume successfully. Sep 21 16:42:32 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=128,cinder:UPDATE=163,cinder:INSERT=29,cinder:DELETE=9 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:42:32 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=132,cinder:UPDATE=148,cinder:INSERT=48,cinder:DELETE=15 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:42:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Acquiring lock "cinder-quobyte-3614861a-cda9-44b2-ac95-c808dfc775b7" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Lock "cinder-quobyte-3614861a-cda9-44b2-ac95-c808dfc775b7" acquired by "delete_volume" :: waited 0.033s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:32 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[7734ea9f-447d-48b5-abbc-d4f12a162f6f]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:42:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3614861a-cda9-44b2-ac95-c808dfc775b7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:33 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3614861a-cda9-44b2-ac95-c808dfc775b7 Sep 21 16:42:33 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:33 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3614861a-cda9-44b2-ac95-c808dfc775b7" returned: 0 in 0.528s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3614861a-cda9-44b2-ac95-c808dfc775b7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:33 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3614861a-cda9-44b2-ac95-c808dfc775b7 Sep 21 16:42:33 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:33 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3614861a-cda9-44b2-ac95-c808dfc775b7" returned: 0 in 0.389s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Lock "cinder-quobyte-3614861a-cda9-44b2-ac95-c808dfc775b7" released by "delete_volume" :: held 1.015s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:34 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Created reservations ['7153c1c0-1707-445d-92cd-a9241455c830'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:34 devstack cinder-volume[86030]: WARNING cinder.quota [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1030411701 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1030411701, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:42:34 devstack cinder-volume[86030]: WARNING cinder.quota [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1030411701 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1030411701, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:42:34 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Created reservations ['31a4a2f0-e58f-479d-873d-5a55bc1bbfde', '92ef968a-76e8-4fae-9047-6e26bcf4c16d', '6fa1e5ac-c1b4-4950-b482-372e705ff8ee', '0994e981-3c80-4c9b-9bf0-9ac91daa3aad'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:34 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:42:34 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:34 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.355s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:34 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:42:34 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0b5f9b6a-2ad5-4061-aaa7-db18cd3db38d tempest-GroupsTest-559117188 None] Delete group completed successfully. Sep 21 16:42:35 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-fd384574-5ed4-40ce-8b8c-6559f739d916 tempest-GroupsTest-559117188 None] Created reservations ['34a93983-29d1-4fb5-8a3e-efcc965e243d'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fd384574-5ed4-40ce-8b8c-6559f739d916 tempest-GroupsTest-559117188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fd384574-5ed4-40ce-8b8c-6559f739d916 tempest-GroupsTest-559117188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fd384574-5ed4-40ce-8b8c-6559f739d916 tempest-GroupsTest-559117188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fd384574-5ed4-40ce-8b8c-6559f739d916 tempest-GroupsTest-559117188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fd384574-5ed4-40ce-8b8c-6559f739d916 tempest-GroupsTest-559117188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fd384574-5ed4-40ce-8b8c-6559f739d916 tempest-GroupsTest-559117188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:35 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:42:35 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:36 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fd384574-5ed4-40ce-8b8c-6559f739d916 tempest-GroupsTest-559117188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.415s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:36 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fd384574-5ed4-40ce-8b8c-6559f739d916 tempest-GroupsTest-559117188 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:42:36 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fd384574-5ed4-40ce-8b8c-6559f739d916 tempest-GroupsTest-559117188 None] Delete group completed successfully. Sep 21 16:42:37 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-18f74394-f2ad-4831-a42e-762b8320a3ee tempest-GroupsTest-559117188 None] Group tempest-GroupsTest-Group-530137342: creating Sep 21 16:42:37 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-18f74394-f2ad-4831-a42e-762b8320a3ee tempest-GroupsTest-559117188 None] Group tempest-GroupsTest-Group-530137342: created successfully Sep 21 16:42:37 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-18f74394-f2ad-4831-a42e-762b8320a3ee tempest-GroupsTest-559117188 None] Create group completed successfully. Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Flow 'volume_create_manager' (4da3f39f-7ba5-43bf-9ca8-7229661956af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e0627c-2cf5-410f-9452-c2949a2847ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e0627c-2cf5-410f-9452-c2949a2847ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-471658008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0034a493-ddf0-42b7-b4c2-2b04ce3e6523,host='devstack@QuobyteHD#QuobyteHD',id=70c7492b-6640-4f0d-8d75-69dfea7ee084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86954126d7143cdb880b24a4dfa9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:39Z,use_quota=True,user_id='b179e46a0bf24cf49765424862ef8dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d89c7115-d761-434e-b719-ab5f8483b2cc),volume_type_id=d89c7115-d761-434e-b719-ab5f8483b2cc)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d56a440-9325-4a76-a362-9910fd1ad59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d56a440-9325-4a76-a362-9910fd1ad59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3139c20-3cea-4dbf-a8d2-126a4e94f605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3139c20-3cea-4dbf-a8d2-126a4e94f605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c7492b-6640-4f0d-8d75-69dfea7ee084', 'volume_name': 'volume-70c7492b-6640-4f0d-8d75-69dfea7ee084', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46aa1057-586c-4a21-875e-63f64e07ceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46aa1057-586c-4a21-875e-63f64e07ceb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56fc68b-db2d-4f97-b506-56e59fdf74f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:39 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Volume 70c7492b-6640-4f0d-8d75-69dfea7ee084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c7492b-6640-4f0d-8d75-69dfea7ee084', 'volume_size': 1} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0034a493-ddf0-42b7-b4c2-2b04ce3e6523,created_at=2026-09-21T14:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-471658008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0034a493-ddf0-42b7-b4c2-2b04ce3e6523,host='devstack@QuobyteHD#QuobyteHD',id=70c7492b-6640-4f0d-8d75-69dfea7ee084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86954126d7143cdb880b24a4dfa9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:39Z,use_quota=True,user_id='b179e46a0bf24cf49765424862ef8dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d89c7115-d761-434e-b719-ab5f8483b2cc),volume_type_id=d89c7115-d761-434e-b719-ab5f8483b2cc)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Creating volume 70c7492b-6640-4f0d-8d75-69dfea7ee084 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:42:39 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-70c7492b-6640-4f0d-8d75-69dfea7ee084 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:39 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-70c7492b-6640-4f0d-8d75-69dfea7ee084 1073741824 Sep 21 16:42:39 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:39 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-70c7492b-6640-4f0d-8d75-69dfea7ee084 1073741824" returned: 0 in 0.599s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-70c7492b-6640-4f0d-8d75-69dfea7ee084 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:40 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-70c7492b-6640-4f0d-8d75-69dfea7ee084 Sep 21 16:42:40 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:40 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-70c7492b-6640-4f0d-8d75-69dfea7ee084" returned: 0 in 0.268s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:42:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56fc68b-db2d-4f97-b506-56e59fdf74f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c7492b-6640-4f0d-8d75-69dfea7ee084', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe05003e-2eb5-41f9-a6f7-7497687dda3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:40 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Volume volume-70c7492b-6640-4f0d-8d75-69dfea7ee084 (70c7492b-6640-4f0d-8d75-69dfea7ee084): created successfully Sep 21 16:42:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe05003e-2eb5-41f9-a6f7-7497687dda3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Flow 'volume_create_manager' (4da3f39f-7ba5-43bf-9ca8-7229661956af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:40 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fcde4ae2-f9a3-41ce-bd50-0ed430b8ce48 tempest-GroupsTest-559117188 None] Created volume successfully. Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Flow 'volume_create_manager' (ab327398-980a-4925-a550-b639f58744eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5846b6bd-c1e8-46da-948c-ed215f0a2597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5846b6bd-c1e8-46da-948c-ed215f0a2597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-341637376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0034a493-ddf0-42b7-b4c2-2b04ce3e6523,host='devstack@QuobyteHD#QuobyteHD',id=fb4869d0-a2c1-4d96-b0b5-d011201b4afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86954126d7143cdb880b24a4dfa9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:41Z,use_quota=True,user_id='b179e46a0bf24cf49765424862ef8dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d89c7115-d761-434e-b719-ab5f8483b2cc),volume_type_id=d89c7115-d761-434e-b719-ab5f8483b2cc)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4de2f8e-b547-4da8-9672-248f6cc67b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4de2f8e-b547-4da8-9672-248f6cc67b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6a4c4f-2cd2-46cf-92ce-44fc05e91a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6a4c4f-2cd2-46cf-92ce-44fc05e91a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb4869d0-a2c1-4d96-b0b5-d011201b4afb', 'volume_name': 'volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b43e13-6897-4055-af8d-6dc1fdf0d549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b43e13-6897-4055-af8d-6dc1fdf0d549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55222b13-a4c7-439e-94c1-4df34b3c50d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:41 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Volume fb4869d0-a2c1-4d96-b0b5-d011201b4afb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb', 'volume_size': 1} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0034a493-ddf0-42b7-b4c2-2b04ce3e6523,created_at=2026-09-21T14:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-341637376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0034a493-ddf0-42b7-b4c2-2b04ce3e6523,host='devstack@QuobyteHD#QuobyteHD',id=fb4869d0-a2c1-4d96-b0b5-d011201b4afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86954126d7143cdb880b24a4dfa9dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:42:41Z,use_quota=True,user_id='b179e46a0bf24cf49765424862ef8dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d89c7115-d761-434e-b719-ab5f8483b2cc),volume_type_id=d89c7115-d761-434e-b719-ab5f8483b2cc)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Creating volume fb4869d0-a2c1-4d96-b0b5-d011201b4afb {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:42:41 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:41 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb 1073741824 Sep 21 16:42:41 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:41 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb 1073741824" returned: 0 in 0.554s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:41 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb Sep 21 16:42:41 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:42 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb" returned: 0 in 0.272s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:42:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55222b13-a4c7-439e-94c1-4df34b3c50d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b02982-d19d-4911-865f-1be0c6b41d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:42:42 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Volume volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb (fb4869d0-a2c1-4d96-b0b5-d011201b4afb): created successfully Sep 21 16:42:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b02982-d19d-4911-865f-1be0c6b41d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:42:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Flow 'volume_create_manager' (ab327398-980a-4925-a550-b639f58744eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:42:42 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-667a47ea-26fc-4dc9-bab0-6bf1743b2f10 tempest-GroupsTest-559117188 None] Created volume successfully. Sep 21 16:42:42 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-2e90c209-5b63-4cc4-bfbe-8f42b2f4b0f9 tempest-GroupsTest-559117188 None] Update group completed successfully. Sep 21 16:42:44 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e84a3cf4-11e6-4ab3-b37a-f514b4eb4fc7 tempest-GroupsTest-559117188 None] Update group completed successfully. Sep 21 16:42:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Acquiring lock "cinder-quobyte-70c7492b-6640-4f0d-8d75-69dfea7ee084" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Lock "cinder-quobyte-70c7492b-6640-4f0d-8d75-69dfea7ee084" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:45 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbbc4bd-ad1b-447f-9686-6a129cf524cc]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:42:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-70c7492b-6640-4f0d-8d75-69dfea7ee084 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:46 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-70c7492b-6640-4f0d-8d75-69dfea7ee084 Sep 21 16:42:46 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:46 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-70c7492b-6640-4f0d-8d75-69dfea7ee084" returned: 0 in 0.566s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-70c7492b-6640-4f0d-8d75-69dfea7ee084 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:46 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-70c7492b-6640-4f0d-8d75-69dfea7ee084 Sep 21 16:42:46 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:46 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-70c7492b-6640-4f0d-8d75-69dfea7ee084" returned: 0 in 0.327s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Lock "cinder-quobyte-70c7492b-6640-4f0d-8d75-69dfea7ee084" released by "delete_volume" :: held 0.970s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Acquiring lock "cinder-quobyte-fb4869d0-a2c1-4d96-b0b5-d011201b4afb" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:42:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Lock "cinder-quobyte-fb4869d0-a2c1-4d96-b0b5-d011201b4afb" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:42:46 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf4d2e6-293d-4785-80fb-bb2ffc73b5ce]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:42:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:47 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb Sep 21 16:42:47 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:47 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb" returned: 0 in 0.475s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:47 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb Sep 21 16:42:47 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:47 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fb4869d0-a2c1-4d96-b0b5-d011201b4afb" returned: 0 in 0.290s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Lock "cinder-quobyte-fb4869d0-a2c1-4d96-b0b5-d011201b4afb" released by "delete_volume" :: held 0.826s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:42:47 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Created reservations ['c2e2aaf1-cbd0-46f0-b483-1529824dd29f'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:47 devstack cinder-volume[86030]: WARNING cinder.quota [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-16363254 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-16363254, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:42:47 devstack cinder-volume[86030]: WARNING cinder.quota [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-16363254 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-16363254, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:42:47 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Created reservations ['7250b5f7-553a-4c7d-951b-8987e985f5f3', '1f442dc0-80eb-4fa7-b557-9fa9322906a2', '3e42209a-af69-45ba-8fc6-fbc1de926373', 'a95df007-d5cd-44e8-8c8c-1b6de836f510'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:47 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Created reservations ['be182eee-049a-4d56-9246-81bd13d485b4', '77edaec9-17b5-4a86-8ab8-998bdc4d8aaf', '44088f37-936b-4c38-991a-4972dba955b4', '7edc4bcc-2dde-4278-a483-4baa56e71691'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:42:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:42:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:42:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:42:48 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:42:48 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:42:48 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Sep 21 16:42:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.435s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:42:48 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:42:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0978d484-2361-4207-a35d-2285b17e8eb4 tempest-GroupsTest-559117188 None] Delete group completed successfully. Sep 21 16:42:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-1441ef65-02e9-44df-b6e4-0b20e1cd7c33 req-a03be302-bdb0-4b89-b869-1740c3a6aad4 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-1441ef65-02e9-44df-b6e4-0b20e1cd7c33 req-a03be302-bdb0-4b89-b869-1740c3a6aad4 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-1441ef65-02e9-44df-b6e4-0b20e1cd7c33 req-a03be302-bdb0-4b89-b869-1740c3a6aad4 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-1441ef65-02e9-44df-b6e4-0b20e1cd7c33 req-a03be302-bdb0-4b89-b869-1740c3a6aad4 tempest-TestInstancesWithCinderVolumes-1956270381 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3df821e7-0e4b-4127-9680-ee16f65fe212', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:42:51 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-1441ef65-02e9-44df-b6e4-0b20e1cd7c33 req-a03be302-bdb0-4b89-b869-1740c3a6aad4 tempest-TestInstancesWithCinderVolumes-1956270381 None] attachment_update completed successfully. Sep 21 16:42:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-a07d5a8b-e24b-41fd-a23e-0c51f037a888 req-a3bf517c-f7d5-4fbe-9183-d44ef6956294 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:42:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-a07d5a8b-e24b-41fd-a23e-0c51f037a888 req-a3bf517c-f7d5-4fbe-9183-d44ef6956294 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:42:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-a07d5a8b-e24b-41fd-a23e-0c51f037a888 req-a3bf517c-f7d5-4fbe-9183-d44ef6956294 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:42:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-a07d5a8b-e24b-41fd-a23e-0c51f037a888 req-a3bf517c-f7d5-4fbe-9183-d44ef6956294 tempest-TestInstancesWithCinderVolumes-1956270381 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-197c2428-6f9f-4d57-bd58-6f8e4738b585', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f8550a6-4542-4312-a16d-334b6f7cb94a', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:42:54 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-a07d5a8b-e24b-41fd-a23e-0c51f037a888 req-a3bf517c-f7d5-4fbe-9183-d44ef6956294 tempest-TestInstancesWithCinderVolumes-1956270381 None] attachment_update completed successfully. Sep 21 16:43:01 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-24f8cf75-8626-462d-affe-cb66f511f566 req-2f003ca3-53c4-4dbb-b9d4-2a6b84aa1a4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Terminate volume connection completed successfully. Sep 21 16:43:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-24f8cf75-8626-462d-affe-cb66f511f566 req-2f003ca3-53c4-4dbb-b9d4-2a6b84aa1a4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Deleting attachment 3df821e7-0e4b-4127-9680-ee16f65fe212. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:43:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "cinder-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "cinder-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "cinder-quobyte-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "cinder-quobyte-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9" acquired by "delete_volume" :: waited 0.038s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:02 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[32796d47-be52-4f19-814b-c567302bcd45]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:43:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:02 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9 Sep 21 16:43:02 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:02 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9" returned: 0 in 0.680s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:02 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9 Sep 21 16:43:02 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:03 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9" returned: 0 in 0.512s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "cinder-quobyte-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9" released by "delete_volume" :: held 1.286s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:03 devstack cinder-volume[86030]: WARNING cinder.quota [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-207732776-1185194814 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-207732776-1185194814, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:43:03 devstack cinder-volume[86030]: WARNING cinder.quota [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-207732776-1185194814 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-207732776-1185194814, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:43:03 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Created reservations ['d1938328-e856-4b04-84e8-e48a8f5b28aa', 'e3c63486-2569-4c21-a41e-5722744f4905', '85faacda-e063-4780-a25d-c3d71bc56f0a', '15d19d7a-b085-47e5-bdd1-06fee40bebc3'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:43:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:43:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:43:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:03 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:43:03 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:03 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.323s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:03 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:43:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Deleted volume successfully. Sep 21 16:43:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ffbb66e8-0d2c-4e22-9e73-24f57b930d4b tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "cinder-0f0eb0a3-38f8-4696-81b6-75ed00cd88a9-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-c2faee61-fc98-482e-9722-b096317b4fcd req-ebe45c73-e4fe-48cd-86be-ab8130d3d078 tempest-TestInstancesWithCinderVolumes-1956270381 None] Terminate volume connection completed successfully. Sep 21 16:43:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-c2faee61-fc98-482e-9722-b096317b4fcd req-ebe45c73-e4fe-48cd-86be-ab8130d3d078 tempest-TestInstancesWithCinderVolumes-1956270381 None] Deleting attachment 1f8550a6-4542-4312-a16d-334b6f7cb94a. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:43:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "cinder-197c2428-6f9f-4d57-bd58-6f8e4738b585-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "cinder-197c2428-6f9f-4d57-bd58-6f8e4738b585-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "cinder-quobyte-197c2428-6f9f-4d57-bd58-6f8e4738b585" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "cinder-quobyte-197c2428-6f9f-4d57-bd58-6f8e4738b585" acquired by "delete_volume" :: waited 0.077s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:43:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:43:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:43:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a4d35e-93a4-45c1-b55d-fd51c736e7b7]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:43:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-197c2428-6f9f-4d57-bd58-6f8e4738b585 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:07 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:43:07 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:08 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-197c2428-6f9f-4d57-bd58-6f8e4738b585 Sep 21 16:43:08 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:08 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.589s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:43:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:43:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 28 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:43:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:43:08 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-197c2428-6f9f-4d57-bd58-6f8e4738b585" returned: 0 in 0.971s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-197c2428-6f9f-4d57-bd58-6f8e4738b585 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:08 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-197c2428-6f9f-4d57-bd58-6f8e4738b585 Sep 21 16:43:08 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:09 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-197c2428-6f9f-4d57-bd58-6f8e4738b585" returned: 0 in 0.534s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "cinder-quobyte-197c2428-6f9f-4d57-bd58-6f8e4738b585" released by "delete_volume" :: held 1.669s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:09 devstack cinder-volume[86030]: WARNING cinder.quota [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-185554019-508576267 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-185554019-508576267, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:43:09 devstack cinder-volume[86030]: WARNING cinder.quota [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-185554019-508576267 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-185554019-508576267, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:43:09 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Created reservations ['caf537cf-4db6-46e5-9e10-70a1e3387820', '7c936f06-77db-444d-8576-de7a39de9000', '0b3db245-6ab5-4856-81a8-5e4ab0524a53', '2ca00a1e-55f2-4ada-afd2-e4fb572a2559'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:43:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:43:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:43:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:09 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:43:09 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:10 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.399s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:10 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:43:10 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Deleted volume successfully. Sep 21 16:43:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e9d7b48e-eef3-45ee-b3c2-b5749947c824 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "cinder-197c2428-6f9f-4d57-bd58-6f8e4738b585-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:16 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-8ff66b31-46b1-47c0-be6e-a00d95e9fd1a req-54b995be-082e-4b4a-ac4e-962013e81ed7 tempest-TestInstancesWithCinderVolumes-1956270381 None] Terminate volume connection completed successfully. Sep 21 16:43:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-8ff66b31-46b1-47c0-be6e-a00d95e9fd1a req-54b995be-082e-4b4a-ac4e-962013e81ed7 tempest-TestInstancesWithCinderVolumes-1956270381 None] Deleting attachment 1fd05974-96b8-4e98-9c16-d3357645ba16. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:43:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "cinder-02ac8b71-c469-4aea-a9c8-53f83c8a9610-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "cinder-02ac8b71-c469-4aea-a9c8-53f83c8a9610-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "cinder-quobyte-02ac8b71-c469-4aea-a9c8-53f83c8a9610" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "cinder-quobyte-02ac8b71-c469-4aea-a9c8-53f83c8a9610" acquired by "delete_volume" :: waited 0.031s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:19 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f0a6ff-8bbb-4c2d-8d63-0e9a9e671ff0]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:43:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:19 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 Sep 21 16:43:19 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:20 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610" returned: 0 in 0.518s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:20 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610 Sep 21 16:43:20 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:20 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-02ac8b71-c469-4aea-a9c8-53f83c8a9610" returned: 0 in 0.559s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "cinder-quobyte-02ac8b71-c469-4aea-a9c8-53f83c8a9610" released by "delete_volume" :: held 1.150s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:20 devstack cinder-volume[86030]: WARNING cinder.quota [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-487986675-421484653 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-487986675-421484653, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:43:20 devstack cinder-volume[86030]: WARNING cinder.quota [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-487986675-421484653 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-487986675-421484653, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:43:20 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Created reservations ['6e10beaa-2d74-4995-8594-42537a215391', 'ff870d7a-4680-41c4-8c7b-7192132cd516', '00b3ebfa-4120-41b8-8ae0-7b50f0dcf180', '5f0f855d-80bc-40dd-bec4-6604e96e48a1'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:43:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:43:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:43:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:21 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:43:21 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:21 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.358s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:21 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:43:21 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Deleted volume successfully. Sep 21 16:43:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c994b31-04bf-4828-b61d-72a1e4319003 tempest-TestInstancesWithCinderVolumes-1956270381 None] Lock "cinder-02ac8b71-c469-4aea-a9c8-53f83c8a9610-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:31 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=62,cinder:SELECT=67,cinder:INSERT=17,cinder:DELETE=2 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:43:31 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=66,cinder:UPDATE=74,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Flow 'volume_create_manager' (8556bdee-9b97-42c6-9767-b3e99a5f1b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0d786c-c0ba-485e-ac1c-7002fd2cad92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0d786c-c0ba-485e-ac1c-7002fd2cad92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1967369324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f42ae55-f73c-4b41-8f28-44543175a7cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cd6b5d298744279bb532a57c7addc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:43:35Z,use_quota=True,user_id='f1da8ffd1c0b4b5984c351b9a8954f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131dac20-859a-4305-b7d9-4f383d6bd71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131dac20-859a-4305-b7d9-4f383d6bd71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2cd31a-c0a8-49f0-94fd-640aac39bac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2cd31a-c0a8-49f0-94fd-640aac39bac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f42ae55-f73c-4b41-8f28-44543175a7cf', 'volume_name': 'volume-4f42ae55-f73c-4b41-8f28-44543175a7cf', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2903ceb3-45d2-4edf-9397-79134c9fa428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2903ceb3-45d2-4edf-9397-79134c9fa428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9964b3a-8598-481e-b1ac-6942d1fff286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:34 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Volume 4f42ae55-f73c-4b41-8f28-44543175a7cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f42ae55-f73c-4b41-8f28-44543175a7cf', 'volume_size': 1} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1967369324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f42ae55-f73c-4b41-8f28-44543175a7cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cd6b5d298744279bb532a57c7addc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:43:35Z,use_quota=True,user_id='f1da8ffd1c0b4b5984c351b9a8954f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Creating volume 4f42ae55-f73c-4b41-8f28-44543175a7cf {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:43:34 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:43:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f42ae55-f73c-4b41-8f28-44543175a7cf 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:34 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f42ae55-f73c-4b41-8f28-44543175a7cf 1073741824 Sep 21 16:43:34 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:35 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f42ae55-f73c-4b41-8f28-44543175a7cf 1073741824" returned: 0 in 0.665s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f42ae55-f73c-4b41-8f28-44543175a7cf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:35 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f42ae55-f73c-4b41-8f28-44543175a7cf Sep 21 16:43:35 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:35 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f42ae55-f73c-4b41-8f28-44543175a7cf" returned: 0 in 0.358s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:43:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9964b3a-8598-481e-b1ac-6942d1fff286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f42ae55-f73c-4b41-8f28-44543175a7cf', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd93a796-2e91-43fd-9690-f28e1f8cedf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:35 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Volume volume-4f42ae55-f73c-4b41-8f28-44543175a7cf (4f42ae55-f73c-4b41-8f28-44543175a7cf): created successfully Sep 21 16:43:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd93a796-2e91-43fd-9690-f28e1f8cedf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Flow 'volume_create_manager' (8556bdee-9b97-42c6-9767-b3e99a5f1b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:43:35 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-01583553-614b-46c6-ac8c-a0b3debf147e tempest-VolumeQuotasAdminTestJSON-703130826 None] Created volume successfully. Sep 21 16:43:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Acquiring lock "cinder-4f42ae55-f73c-4b41-8f28-44543175a7cf-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "cinder-4f42ae55-f73c-4b41-8f28-44543175a7cf-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Acquiring lock "cinder-quobyte-4f42ae55-f73c-4b41-8f28-44543175a7cf" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "cinder-quobyte-4f42ae55-f73c-4b41-8f28-44543175a7cf" acquired by "delete_volume" :: waited 0.059s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb423f5-5f61-4283-aec4-690c453903fd]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f42ae55-f73c-4b41-8f28-44543175a7cf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:37 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f42ae55-f73c-4b41-8f28-44543175a7cf Sep 21 16:43:37 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Flow 'volume_create_manager' (9d23ae31-96fb-4162-b26b-bad798341167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d933f4f-1c04-4591-8da9-cf128464969a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d933f4f-1c04-4591-8da9-cf128464969a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2118072371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0d6873-49f6-462a-9a5e-52e3fccce32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5a03f7c0694b9ca232b161f47148c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:43:37Z,use_quota=True,user_id='e1e5a2c23308439f84f7ecd8fdcf741c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bc4ba2-ddad-406f-ad80-e97034d97d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bc4ba2-ddad-406f-ad80-e97034d97d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe94a00-be72-4341-b07f-b78d56b2120c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe94a00-be72-4341-b07f-b78d56b2120c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e0d6873-49f6-462a-9a5e-52e3fccce32b', 'volume_name': 'volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1209d06e-ddb6-4be0-b9c0-cb2f8f5bc856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1209d06e-ddb6-4be0-b9c0-cb2f8f5bc856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d0a1c5-4665-428c-a356-63e4069cd68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:37 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Volume 6e0d6873-49f6-462a-9a5e-52e3fccce32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b', 'volume_size': 1} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2118072371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0d6873-49f6-462a-9a5e-52e3fccce32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5a03f7c0694b9ca232b161f47148c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:43:37Z,use_quota=True,user_id='e1e5a2c23308439f84f7ecd8fdcf741c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Creating volume 6e0d6873-49f6-462a-9a5e-52e3fccce32b {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:43:37 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:37 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f42ae55-f73c-4b41-8f28-44543175a7cf" returned: 0 in 0.500s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f42ae55-f73c-4b41-8f28-44543175a7cf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:37 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b 1073741824 Sep 21 16:43:37 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:37 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f42ae55-f73c-4b41-8f28-44543175a7cf Sep 21 16:43:37 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:37 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f42ae55-f73c-4b41-8f28-44543175a7cf" returned: 0 in 0.383s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "cinder-quobyte-4f42ae55-f73c-4b41-8f28-44543175a7cf" released by "delete_volume" :: held 0.979s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Created reservations ['accb2073-a983-42f3-ae65-d25e70593a86', '97977666-0819-4b43-85e6-8b9b66c0a7be', '9d5b6931-99b2-45d1-9d37-493bdaa3dea6', '84f7a5e3-f500-4f2d-8ad8-c4e4b8347353'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:38 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:43:38 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:38 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b 1073741824" returned: 0 in 0.679s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:38 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b Sep 21 16:43:38 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:38 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.341s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:43:38 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Deleted volume successfully. Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f45a4383-bda3-4cbf-94a0-1f650740e0aa tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "cinder-4f42ae55-f73c-4b41-8f28-44543175a7cf-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:38 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b" returned: 0 in 0.324s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d0a1c5-4665-428c-a356-63e4069cd68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4cb0d51-4bc8-49cd-85fb-ad8052449d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:38 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Volume volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b (6e0d6873-49f6-462a-9a5e-52e3fccce32b): created successfully Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4cb0d51-4bc8-49cd-85fb-ad8052449d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Flow 'volume_create_manager' (9d23ae31-96fb-4162-b26b-bad798341167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:43:38 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c099a708-25e4-4844-b7bb-a34b11d443f0 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Created volume successfully. Sep 21 16:43:39 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:43:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Flow 'volume_create_manager' (7992fdd3-e818-439d-a017-fb2b083dfc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:43:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5762d838-8062-44c2-a3dd-0054ec055c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5762d838-8062-44c2-a3dd-0054ec055c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-590259896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f86d97b-a42c-452b-894b-edec99c96917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cd6b5d298744279bb532a57c7addc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:43:40Z,use_quota=True,user_id='f1da8ffd1c0b4b5984c351b9a8954f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a55755-5905-4da7-a773-6791ead01e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a55755-5905-4da7-a773-6791ead01e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b564369a-3984-4236-a378-4691246ebcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b564369a-3984-4236-a378-4691246ebcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f86d97b-a42c-452b-894b-edec99c96917', 'volume_name': 'volume-0f86d97b-a42c-452b-894b-edec99c96917', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e02218f-3473-498b-add3-4c1c2a785843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e02218f-3473-498b-add3-4c1c2a785843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2c0a4e-f224-4db5-af41-6dcb4c4c66fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:40 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Volume 0f86d97b-a42c-452b-894b-edec99c96917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f86d97b-a42c-452b-894b-edec99c96917', 'volume_size': 1} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-590259896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f86d97b-a42c-452b-894b-edec99c96917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cd6b5d298744279bb532a57c7addc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:43:40Z,use_quota=True,user_id='f1da8ffd1c0b4b5984c351b9a8954f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Creating volume 0f86d97b-a42c-452b-894b-edec99c96917 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:43:40 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:43:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f86d97b-a42c-452b-894b-edec99c96917 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:40 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f86d97b-a42c-452b-894b-edec99c96917 1073741824 Sep 21 16:43:40 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:41 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f86d97b-a42c-452b-894b-edec99c96917 1073741824" returned: 0 in 0.948s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f86d97b-a42c-452b-894b-edec99c96917 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:41 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f86d97b-a42c-452b-894b-edec99c96917 Sep 21 16:43:41 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-ebc21198-e20e-4e0f-97db-3ddd7fcca9a4 req-11703d55-f4be-4f7e-a7a0-3bff9ee02705 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:41 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f86d97b-a42c-452b-894b-edec99c96917" returned: 0 in 0.351s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:43:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-ebc21198-e20e-4e0f-97db-3ddd7fcca9a4 req-11703d55-f4be-4f7e-a7a0-3bff9ee02705 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.282s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-ebc21198-e20e-4e0f-97db-3ddd7fcca9a4 req-11703d55-f4be-4f7e-a7a0-3bff9ee02705 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2c0a4e-f224-4db5-af41-6dcb4c4c66fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f86d97b-a42c-452b-894b-edec99c96917', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a82b7b4-673f-4b2e-a8ed-0e08a48e528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:41 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Volume volume-0f86d97b-a42c-452b-894b-edec99c96917 (0f86d97b-a42c-452b-894b-edec99c96917): created successfully Sep 21 16:43:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a82b7b4-673f-4b2e-a8ed-0e08a48e528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Flow 'volume_create_manager' (7992fdd3-e818-439d-a017-fb2b083dfc6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:43:41 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5976b2f0-b60d-48f4-9b39-b7cdcd6366df tempest-VolumeQuotasAdminTestJSON-703130826 None] Created volume successfully. Sep 21 16:43:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-ebc21198-e20e-4e0f-97db-3ddd7fcca9a4 req-11703d55-f4be-4f7e-a7a0-3bff9ee02705 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c6ba98f-35eb-4df5-81cf-4a8ca074a7f4', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:43:41 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-ebc21198-e20e-4e0f-97db-3ddd7fcca9a4 req-11703d55-f4be-4f7e-a7a0-3bff9ee02705 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] attachment_update completed successfully. Sep 21 16:43:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-cf1cada4-899e-46f5-8114-1be46de346f6 tempest-VolumeQuotasAdminTestJSON-698051318 None] Transfer volume completed successfully. Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Acquiring lock "cinder-0f86d97b-a42c-452b-894b-edec99c96917-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Lock "cinder-0f86d97b-a42c-452b-894b-edec99c96917-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Acquiring lock "cinder-quobyte-0f86d97b-a42c-452b-894b-edec99c96917" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Lock "cinder-quobyte-0f86d97b-a42c-452b-894b-edec99c96917" acquired by "delete_volume" :: waited 0.041s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Flow 'volume_create_manager' (c754e9a7-1dde-4688-9586-5442bbb7db57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48d5ae8-1a68-4fdb-a275-c9e44a607efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcbbb78-f2c0-4207-a159-fa6793424c72]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f86d97b-a42c-452b-894b-edec99c96917 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48d5ae8-1a68-4fdb-a275-c9e44a607efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1583292593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bffc025-695b-493e-bc35-bd05bedc903b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bc8d90a0f4bab81cc7fc941d180c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:43:45Z,use_quota=True,user_id='e4f7ed354a474725bb6339d8cfe5d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b813f20b-4ea0-45a0-8907-1ab7ff4b5173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b813f20b-4ea0-45a0-8907-1ab7ff4b5173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a69759e-c71d-48c8-bff2-21306cec14a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a69759e-c71d-48c8-bff2-21306cec14a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bffc025-695b-493e-bc35-bd05bedc903b', 'volume_name': 'volume-5bffc025-695b-493e-bc35-bd05bedc903b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72f9bb4-2d2c-40c6-b34b-a6ffcd5694c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72f9bb4-2d2c-40c6-b34b-a6ffcd5694c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33e137f-3988-48fb-b413-b9d3e6ec38cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:44 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Volume 5bffc025-695b-493e-bc35-bd05bedc903b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bffc025-695b-493e-bc35-bd05bedc903b', 'volume_size': 1} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1583292593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bffc025-695b-493e-bc35-bd05bedc903b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bc8d90a0f4bab81cc7fc941d180c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:43:45Z,use_quota=True,user_id='e4f7ed354a474725bb6339d8cfe5d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Creating volume 5bffc025-695b-493e-bc35-bd05bedc903b {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:43:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:43:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:43:45 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:43:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5bffc025-695b-493e-bc35-bd05bedc903b 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:45 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5bffc025-695b-493e-bc35-bd05bedc903b 1073741824 Sep 21 16:43:45 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:45 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f86d97b-a42c-452b-894b-edec99c96917 Sep 21 16:43:45 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:45 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f86d97b-a42c-452b-894b-edec99c96917" returned: 0 in 0.721s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f86d97b-a42c-452b-894b-edec99c96917 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:45 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f86d97b-a42c-452b-894b-edec99c96917 Sep 21 16:43:45 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:45 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5bffc025-695b-493e-bc35-bd05bedc903b 1073741824" returned: 0 in 0.770s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5bffc025-695b-493e-bc35-bd05bedc903b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:45 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5bffc025-695b-493e-bc35-bd05bedc903b Sep 21 16:43:45 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:46 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0f86d97b-a42c-452b-894b-edec99c96917" returned: 0 in 0.409s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Lock "cinder-quobyte-0f86d97b-a42c-452b-894b-edec99c96917" released by "delete_volume" :: held 1.251s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Created reservations ['41cad0cf-3365-4a35-ae89-642a64836f61', '8b526fb7-49c9-4fe2-904d-883b21aedef3', 'f2b97947-71e2-4948-a60e-5b07a6c207b3', '35a2b434-1de9-4a76-92bd-fb7d74367573'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:43:46 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5bffc025-695b-493e-bc35-bd05bedc903b" returned: 0 in 0.451s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33e137f-3988-48fb-b413-b9d3e6ec38cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bffc025-695b-493e-bc35-bd05bedc903b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:46 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136c9a5a-ba86-4538-9758-85319dd2052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:43:46 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:46 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Volume volume-5bffc025-695b-493e-bc35-bd05bedc903b (5bffc025-695b-493e-bc35-bd05bedc903b): created successfully Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136c9a5a-ba86-4538-9758-85319dd2052f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Flow 'volume_create_manager' (c754e9a7-1dde-4688-9586-5442bbb7db57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:43:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-bf17eb75-df0f-4c65-ae3e-ee1a4f46ee79 tempest-VolumesActionsTest-1580925557 None] Created volume successfully. Sep 21 16:43:46 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.297s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:43:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Deleted volume successfully. Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4ac30ebc-0cef-46a1-a26b-08c2a8198c6f tempest-VolumeQuotasAdminTestJSON-1214458370 None] Lock "cinder-0f86d97b-a42c-452b-894b-edec99c96917-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0a583ac6-5cb4-41fa-acb3-8317d6199edd tempest-VolumesActionsTest-1580925557 None] Acquiring lock "cinder-5bffc025-695b-493e-bc35-bd05bedc903b" by "attach_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0a583ac6-5cb4-41fa-acb3-8317d6199edd tempest-VolumesActionsTest-1580925557 None] Lock "cinder-5bffc025-695b-493e-bc35-bd05bedc903b" acquired by "attach_volume" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:47 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0a583ac6-5cb4-41fa-acb3-8317d6199edd tempest-VolumesActionsTest-1580925557 None] Attaching volume 5bffc025-695b-493e-bc35-bd05bedc903b to instance d2661d52-a901-4d2a-8097-a49d4ba95d79 at mountpoint /dev/vdb on host None. Sep 21 16:43:47 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0a583ac6-5cb4-41fa-acb3-8317d6199edd tempest-VolumesActionsTest-1580925557 None] Attach volume completed successfully. Sep 21 16:43:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0a583ac6-5cb4-41fa-acb3-8317d6199edd tempest-VolumesActionsTest-1580925557 None] Lock "cinder-5bffc025-695b-493e-bc35-bd05bedc903b" released by "attach_volume" :: held 0.186s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:47 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-576370b8-3f0d-4d91-a95c-6531c1309b04 req-8d486b26-3301-411e-9923-7dc17865e3c3 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Terminate volume connection completed successfully. Sep 21 16:43:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-576370b8-3f0d-4d91-a95c-6531c1309b04 req-8d486b26-3301-411e-9923-7dc17865e3c3 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Deleting attachment 1c6ba98f-35eb-4df5-81cf-4a8ca074a7f4. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:43:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ce893894-3764-46c2-ac4e-941907fcbf7d tempest-VolumesActionsTest-998980453 None] Terminate volume connection completed successfully. Sep 21 16:43:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Acquiring lock "cinder-6e0d6873-49f6-462a-9a5e-52e3fccce32b-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Lock "cinder-6e0d6873-49f6-462a-9a5e-52e3fccce32b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ce893894-3764-46c2-ac4e-941907fcbf7d tempest-VolumesActionsTest-998980453 None] Acquiring lock "cinder-5bffc025-695b-493e-bc35-bd05bedc903b-detach_volume" by "detach_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ce893894-3764-46c2-ac4e-941907fcbf7d tempest-VolumesActionsTest-998980453 None] Lock "cinder-5bffc025-695b-493e-bc35-bd05bedc903b-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Acquiring lock "cinder-quobyte-6e0d6873-49f6-462a-9a5e-52e3fccce32b" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Lock "cinder-quobyte-6e0d6873-49f6-462a-9a5e-52e3fccce32b" acquired by "delete_volume" :: waited 0.035s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ce893894-3764-46c2-ac4e-941907fcbf7d tempest-VolumesActionsTest-998980453 None] Detaching volume 5bffc025-695b-493e-bc35-bd05bedc903b from instance d2661d52-a901-4d2a-8097-a49d4ba95d79. Sep 21 16:43:48 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c97248c-eaa7-45d5-97d6-00c6f8ca5726]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:43:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ce893894-3764-46c2-ac4e-941907fcbf7d tempest-VolumesActionsTest-998980453 None] Detach volume completed successfully. Sep 21 16:43:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ce893894-3764-46c2-ac4e-941907fcbf7d tempest-VolumesActionsTest-998980453 None] Lock "cinder-5bffc025-695b-493e-bc35-bd05bedc903b-detach_volume" released by "detach_volume" :: held 0.180s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:48 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b Sep 21 16:43:48 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5cd798a4-63c9-49a4-96be-8820300a6010 tempest-VolumesActionsTest-1580925557 None] Acquiring lock "cinder-5bffc025-695b-493e-bc35-bd05bedc903b-detach_volume" by "detach_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5cd798a4-63c9-49a4-96be-8820300a6010 tempest-VolumesActionsTest-1580925557 None] Lock "cinder-5bffc025-695b-493e-bc35-bd05bedc903b-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5cd798a4-63c9-49a4-96be-8820300a6010 tempest-VolumesActionsTest-1580925557 None] Volume detach called, but volume not attached. Sep 21 16:43:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5cd798a4-63c9-49a4-96be-8820300a6010 tempest-VolumesActionsTest-1580925557 None] Lock "cinder-5bffc025-695b-493e-bc35-bd05bedc903b-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:49 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b" returned: 0 in 0.711s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:49 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b Sep 21 16:43:49 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Acquiring lock "cinder-5bffc025-695b-493e-bc35-bd05bedc903b-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Lock "cinder-5bffc025-695b-493e-bc35-bd05bedc903b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Acquiring lock "cinder-quobyte-5bffc025-695b-493e-bc35-bd05bedc903b" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:43:49 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e0d6873-49f6-462a-9a5e-52e3fccce32b" returned: 0 in 0.440s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Lock "cinder-quobyte-5bffc025-695b-493e-bc35-bd05bedc903b" acquired by "delete_volume" :: waited 0.053s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Lock "cinder-quobyte-6e0d6873-49f6-462a-9a5e-52e3fccce32b" released by "delete_volume" :: held 1.272s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ad6eb-4302-4bec-9771-8286dc6cbeaa]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5bffc025-695b-493e-bc35-bd05bedc903b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Created reservations ['7bdb8efe-36a0-47fe-bc76-5056a7f538d9', 'ee3decc2-2780-439f-835b-2ca6c4841c13', '89b9ed46-1ba9-459f-ab17-10ab61de68cb', 'd7feb7a8-6c63-4867-8cd2-dda2dff13af5'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:49 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:43:49 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:49 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5bffc025-695b-493e-bc35-bd05bedc903b Sep 21 16:43:49 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:50 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.345s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:50 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:43:50 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Deleted volume successfully. Sep 21 16:43:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c76b4e88-ab6c-4f9c-8734-36bfd49b0b63 tempest-TestServerVolumeAttachScenarioOldVersion-534084628 None] Lock "cinder-6e0d6873-49f6-462a-9a5e-52e3fccce32b-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:50 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5bffc025-695b-493e-bc35-bd05bedc903b" returned: 0 in 0.593s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5bffc025-695b-493e-bc35-bd05bedc903b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:50 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5bffc025-695b-493e-bc35-bd05bedc903b Sep 21 16:43:50 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:50 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5bffc025-695b-493e-bc35-bd05bedc903b" returned: 0 in 0.578s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Lock "cinder-quobyte-5bffc025-695b-493e-bc35-bd05bedc903b" released by "delete_volume" :: held 1.277s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:43:51 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Created reservations ['84e0ff0c-9532-4460-aee1-53ad361473d7', '5dfe502a-ffa2-489d-83f7-72567fc3e6a9', '8552ac7e-5756-4471-93cf-cce638037573', '849c44e3-0834-4040-99a8-ac26ced8f827'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:43:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:43:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:43:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:43:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:43:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:43:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:43:51 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:43:51 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:43:51 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Sep 21 16:43:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.570s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:43:51 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:43:51 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Deleted volume successfully. Sep 21 16:43:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4172cdfe-5931-4f2c-8c79-bf5f043259bf tempest-VolumesActionsTest-1580925557 None] Lock "cinder-5bffc025-695b-493e-bc35-bd05bedc903b-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Flow 'volume_create_manager' (138c1f3b-c869-4987-9654-6d4288910cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0286329-aab9-40b6-bdb6-297015c7cb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0286329-aab9-40b6-bdb6-297015c7cb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1317139955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b48f53-75c7-49e1-ba8d-cda6b9b38674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bc8d90a0f4bab81cc7fc941d180c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:00Z,use_quota=True,user_id='e4f7ed354a474725bb6339d8cfe5d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc04056-191b-4fdd-96cd-204eaa201a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc04056-191b-4fdd-96cd-204eaa201a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f272897c-dc1b-4b9a-8352-4f0dcfe06143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f272897c-dc1b-4b9a-8352-4f0dcfe06143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b48f53-75c7-49e1-ba8d-cda6b9b38674', 'volume_name': 'volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6d131a-7316-4bb3-ae5f-84336f1bf895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6d131a-7316-4bb3-ae5f-84336f1bf895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7b0a08-033b-466e-bc3d-2b26ff897d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:00 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Volume b2b48f53-75c7-49e1-ba8d-cda6b9b38674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674', 'volume_size': 1} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1317139955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b48f53-75c7-49e1-ba8d-cda6b9b38674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bc8d90a0f4bab81cc7fc941d180c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:00Z,use_quota=True,user_id='e4f7ed354a474725bb6339d8cfe5d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Creating volume b2b48f53-75c7-49e1-ba8d-cda6b9b38674 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:00 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:00 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674 1073741824 Sep 21 16:44:00 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:01 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674 1073741824" returned: 0 in 0.587s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:01 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674 Sep 21 16:44:01 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:01 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674" returned: 0 in 0.370s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea7b0a08-033b-466e-bc3d-2b26ff897d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10efe632-0671-486e-afc4-866d9ed1350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:01 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Volume volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674 (b2b48f53-75c7-49e1-ba8d-cda6b9b38674): created successfully Sep 21 16:44:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10efe632-0671-486e-afc4-866d9ed1350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Flow 'volume_create_manager' (138c1f3b-c869-4987-9654-6d4288910cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:01 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d10ed95c-a750-4a9f-a0de-ee9bf56821b7 tempest-VolumesActionsTest-1580925557 None] Created volume successfully. Sep 21 16:44:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Acquiring lock "cinder-b2b48f53-75c7-49e1-ba8d-cda6b9b38674-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Lock "cinder-b2b48f53-75c7-49e1-ba8d-cda6b9b38674-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Acquiring lock "cinder-quobyte-b2b48f53-75c7-49e1-ba8d-cda6b9b38674" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Lock "cinder-quobyte-b2b48f53-75c7-49e1-ba8d-cda6b9b38674" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:02 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[990a38f1-eece-4a5f-8d56-681f5eaacecd]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:02 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Flow 'volume_create_manager' (3b999b90-4bfd-484e-ab5c-5a71f91ae549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76da6e26-b437-4f40-a6c0-90a724de7dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:02 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674 Sep 21 16:44:02 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76da6e26-b437-4f40-a6c0-90a724de7dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-285040181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9afebd4-557a-4d12-b7db-475a0c86f2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bdd127f4e24655bfdb14d17d8a1f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:03Z,use_quota=True,user_id='cd35f7984dfd4fdf977f23a571e57b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95ebc7d9-d971-43a8-9e33-ab639ba2d655),volume_type_id=95ebc7d9-d971-43a8-9e33-ab639ba2d655)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5f2c48-4273-46cb-b8f1-b9e447c3a703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5f2c48-4273-46cb-b8f1-b9e447c3a703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be381ac-7d80-4d1c-b122-3c756ea55b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be381ac-7d80-4d1c-b122-3c756ea55b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9afebd4-557a-4d12-b7db-475a0c86f2e4', 'volume_name': 'volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a692f73-1ff8-47d0-9e0d-e443a9cab012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a692f73-1ff8-47d0-9e0d-e443a9cab012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1743b0-e4b0-4f8a-849f-5e69a9f0091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:03 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Volume e9afebd4-557a-4d12-b7db-475a0c86f2e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4', 'volume_size': 1} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-285040181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9afebd4-557a-4d12-b7db-475a0c86f2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bdd127f4e24655bfdb14d17d8a1f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:03Z,use_quota=True,user_id='cd35f7984dfd4fdf977f23a571e57b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95ebc7d9-d971-43a8-9e33-ab639ba2d655),volume_type_id=95ebc7d9-d971-43a8-9e33-ab639ba2d655)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Creating volume e9afebd4-557a-4d12-b7db-475a0c86f2e4 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:03 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:03 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4 1073741824 Sep 21 16:44:03 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:03 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674" returned: 0 in 0.540s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:03 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674 Sep 21 16:44:03 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:03 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4 1073741824" returned: 0 in 0.636s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:03 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b2b48f53-75c7-49e1-ba8d-cda6b9b38674" returned: 0 in 0.318s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Lock "cinder-quobyte-b2b48f53-75c7-49e1-ba8d-cda6b9b38674" released by "delete_volume" :: held 0.940s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:03 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4 Sep 21 16:44:03 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Created reservations ['edaf793f-682b-43df-bf1c-7b36fb33050c', '41ab04fa-3162-4c58-8f19-b1481ef99030', '567dbd42-fb6f-4004-9fff-b3136587402a', '16c0ed04-d5dd-40b2-a3a5-ee96df2d79d6'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:03 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:03 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:04 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4" returned: 0 in 0.312s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1743b0-e4b0-4f8a-849f-5e69a9f0091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7837f9-75c5-4b4a-a845-536b29f4687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:04 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Volume volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4 (e9afebd4-557a-4d12-b7db-475a0c86f2e4): created successfully Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7837f9-75c5-4b4a-a845-536b29f4687a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Flow 'volume_create_manager' (3b999b90-4bfd-484e-ab5c-5a71f91ae549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:04 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-24d5daf4-7a43-4821-9680-6aca89c6683a tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Created volume successfully. Sep 21 16:44:04 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.347s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:04 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Deleted volume successfully. Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-de40d343-c92c-4104-be51-26c7f063d139 tempest-VolumesActionsTest-998980453 None] Lock "cinder-b2b48f53-75c7-49e1-ba8d-cda6b9b38674-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Flow 'volume_create_manager' (39c3574c-b6cc-4ead-ac1b-e8351d5b90ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945eefa2-f141-4218-a8b4-bd6435b95301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945eefa2-f141-4218-a8b4-bd6435b95301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1942461010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f15c26f-4276-4a06-a6de-f795c0e854a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bc8d90a0f4bab81cc7fc941d180c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:05Z,use_quota=True,user_id='e4f7ed354a474725bb6339d8cfe5d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de0d91b-1b69-4b3f-bf72-decb7516c753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de0d91b-1b69-4b3f-bf72-decb7516c753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c885be11-7649-4f04-bc73-8485903869c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c885be11-7649-4f04-bc73-8485903869c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f15c26f-4276-4a06-a6de-f795c0e854a8', 'volume_name': 'volume-4f15c26f-4276-4a06-a6de-f795c0e854a8', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db3ff7c-22ef-4b93-8ddc-e3c880445a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db3ff7c-22ef-4b93-8ddc-e3c880445a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe9f595-ec13-45c9-8a11-57aecbbbb855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:04 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Volume 4f15c26f-4276-4a06-a6de-f795c0e854a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f15c26f-4276-4a06-a6de-f795c0e854a8', 'volume_size': 1} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1942461010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f15c26f-4276-4a06-a6de-f795c0e854a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bc8d90a0f4bab81cc7fc941d180c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:05Z,use_quota=True,user_id='e4f7ed354a474725bb6339d8cfe5d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Creating volume 4f15c26f-4276-4a06-a6de-f795c0e854a8 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:04 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f15c26f-4276-4a06-a6de-f795c0e854a8 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:04 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f15c26f-4276-4a06-a6de-f795c0e854a8 1073741824 Sep 21 16:44:04 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f041ff5f-440f-480f-ba52-83b6d24bdcd2 tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f041ff5f-440f-480f-ba52-83b6d24bdcd2 tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f041ff5f-440f-480f-ba52-83b6d24bdcd2 tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:05 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f041ff5f-440f-480f-ba52-83b6d24bdcd2 tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f041ff5f-440f-480f-ba52-83b6d24bdcd2 tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f041ff5f-440f-480f-ba52-83b6d24bdcd2 tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f15c26f-4276-4a06-a6de-f795c0e854a8 1073741824" returned: 0 in 0.736s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:05 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:05 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f15c26f-4276-4a06-a6de-f795c0e854a8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:05 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f15c26f-4276-4a06-a6de-f795c0e854a8 Sep 21 16:44:05 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:05 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f041ff5f-440f-480f-ba52-83b6d24bdcd2 tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.369s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:05 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-f041ff5f-440f-480f-ba52-83b6d24bdcd2 tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:05 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-f041ff5f-440f-480f-ba52-83b6d24bdcd2 tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Retype volume completed successfully. Sep 21 16:44:05 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f15c26f-4276-4a06-a6de-f795c0e854a8" returned: 0 in 0.321s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe9f595-ec13-45c9-8a11-57aecbbbb855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f15c26f-4276-4a06-a6de-f795c0e854a8', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d548acf-59ff-41c1-aa55-d523cf0abd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:06 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Volume volume-4f15c26f-4276-4a06-a6de-f795c0e854a8 (4f15c26f-4276-4a06-a6de-f795c0e854a8): created successfully Sep 21 16:44:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d548acf-59ff-41c1-aa55-d523cf0abd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Flow 'volume_create_manager' (39c3574c-b6cc-4ead-ac1b-e8351d5b90ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-453e00be-0363-4bce-ab2d-67e31a8099ee tempest-VolumesActionsTest-1580925557 None] Created volume successfully. Sep 21 16:44:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Acquiring lock "cinder-e9afebd4-557a-4d12-b7db-475a0c86f2e4-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Lock "cinder-e9afebd4-557a-4d12-b7db-475a0c86f2e4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Acquiring lock "cinder-quobyte-e9afebd4-557a-4d12-b7db-475a0c86f2e4" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Lock "cinder-quobyte-e9afebd4-557a-4d12-b7db-475a0c86f2e4" acquired by "delete_volume" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Acquiring lock "cinder-4f15c26f-4276-4a06-a6de-f795c0e854a8-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:06 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[29806d10-7492-41e1-8475-e52762e50669]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Lock "cinder-4f15c26f-4276-4a06-a6de-f795c0e854a8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Acquiring lock "cinder-quobyte-4f15c26f-4276-4a06-a6de-f795c0e854a8" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:07 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4 Sep 21 16:44:07 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Lock "cinder-quobyte-4f15c26f-4276-4a06-a6de-f795c0e854a8" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d501e73-9878-4592-83d4-b7808f3e3ec2]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f15c26f-4276-4a06-a6de-f795c0e854a8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:07 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f15c26f-4276-4a06-a6de-f795c0e854a8 Sep 21 16:44:07 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:07 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4" returned: 0 in 0.579s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:07 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4 Sep 21 16:44:07 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:07 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f15c26f-4276-4a06-a6de-f795c0e854a8" returned: 0 in 0.627s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f15c26f-4276-4a06-a6de-f795c0e854a8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:07 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f15c26f-4276-4a06-a6de-f795c0e854a8 Sep 21 16:44:07 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:07 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:07 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:07 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e9afebd4-557a-4d12-b7db-475a0c86f2e4" returned: 0 in 0.424s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Lock "cinder-quobyte-e9afebd4-557a-4d12-b7db-475a0c86f2e4" released by "delete_volume" :: held 1.094s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:08 devstack cinder-volume[86030]: WARNING cinder.quota [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:44:08 devstack cinder-volume[86030]: WARNING cinder.quota [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Created reservations ['5100fd16-a2e7-41eb-8619-bb6295e50134', '00efc7c8-1079-4177-8ce1-4764f4886973', 'c5aaa7fd-5045-4070-9fcf-b94a025c4ddc', '64f93c19-94c0-4a49-aab3-c44eb1afccd0'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:08 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:08 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4f15c26f-4276-4a06-a6de-f795c0e854a8" returned: 0 in 0.562s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.466s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:08 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:08 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Lock "cinder-quobyte-4f15c26f-4276-4a06-a6de-f795c0e854a8" released by "delete_volume" :: held 1.289s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 28 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Created reservations ['1bfd32c8-8438-491f-8212-ebbe2cc6da57', 'b1af9fae-5bca-463e-ad6d-e1173a3e4c61', '961d8c1f-bf28-4177-acbd-b22fa1815b6d', '3b949f87-9954-44b8-a2dc-b0bcf76e0da4'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:08 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:08 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:08 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.324s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:08 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Deleted volume successfully. Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-57487c5b-2364-4902-be7e-d8d558f0f03b tempest-VolumeRetypeWithoutMigrationTest-1423051544 None] Lock "cinder-e9afebd4-557a-4d12-b7db-475a0c86f2e4-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:08 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.309s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:08 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Deleted volume successfully. Sep 21 16:44:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6189100e-6899-43ad-9d04-2b551482c3e2 tempest-VolumesActionsTest-998980453 None] Lock "cinder-4f15c26f-4276-4a06-a6de-f795c0e854a8-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:09 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Flow 'volume_create_manager' (11a7c777-74af-43a9-8187-af552557af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c96706-1d98-4f7d-97d9-84645c2e485a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c96706-1d98-4f7d-97d9-84645c2e485a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-658375959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f23692f-acd8-4578-b65c-0b239b75a650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bc8d90a0f4bab81cc7fc941d180c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:10Z,use_quota=True,user_id='e4f7ed354a474725bb6339d8cfe5d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f165a5b8-e478-4384-9da0-adeee4e12c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f165a5b8-e478-4384-9da0-adeee4e12c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adde38d-148e-4243-bac3-b80803c2388c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9adde38d-148e-4243-bac3-b80803c2388c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f23692f-acd8-4578-b65c-0b239b75a650', 'volume_name': 'volume-3f23692f-acd8-4578-b65c-0b239b75a650', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (689e78db-745a-4869-afba-586e29e634c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (689e78db-745a-4869-afba-586e29e634c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47350485-62a1-44ae-bdb4-ee4cb2bdcc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:10 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Volume 3f23692f-acd8-4578-b65c-0b239b75a650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f23692f-acd8-4578-b65c-0b239b75a650', 'volume_size': 1} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-658375959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f23692f-acd8-4578-b65c-0b239b75a650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bc8d90a0f4bab81cc7fc941d180c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:10Z,use_quota=True,user_id='e4f7ed354a474725bb6339d8cfe5d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Creating volume 3f23692f-acd8-4578-b65c-0b239b75a650 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:10 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3f23692f-acd8-4578-b65c-0b239b75a650 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:10 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3f23692f-acd8-4578-b65c-0b239b75a650 1073741824 Sep 21 16:44:10 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Flow 'volume_create_manager' (b9a0d791-fee9-4b25-b860-a262dc92e9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca00c10-1e5f-4e93-8842-2bc700a258a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca00c10-1e5f-4e93-8842-2bc700a258a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1535944428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b9c1d6-6855-47b6-84db-e8e0e47ace76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb342677994f14bebfd6ce6d2e7c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:10Z,use_quota=True,user_id='fbf1d0ce4e764131bd415d60856a2546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377ec69a-7fbd-4e2b-88b3-948a35cf0862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377ec69a-7fbd-4e2b-88b3-948a35cf0862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683f0e53-e683-4a4e-b5da-05adf7b39d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683f0e53-e683-4a4e-b5da-05adf7b39d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b9c1d6-6855-47b6-84db-e8e0e47ace76', 'volume_name': 'volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f6f201-0633-4452-9595-763e33f48d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f6f201-0633-4452-9595-763e33f48d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb644d3-f356-4b2c-8f57-14125820ed9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:10 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Volume 62b9c1d6-6855-47b6-84db-e8e0e47ace76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76', 'volume_size': 1} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:10 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3f23692f-acd8-4578-b65c-0b239b75a650 1073741824" returned: 0 in 0.725s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3f23692f-acd8-4578-b65c-0b239b75a650 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:10 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3f23692f-acd8-4578-b65c-0b239b75a650 Sep 21 16:44:10 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Flow 'volume_create_manager' (12e361f5-6214-48c3-b0d3-7c21199a66cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dc472e-3150-4eaf-ad98-1f07e6055fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dc472e-3150-4eaf-ad98-1f07e6055fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1592667256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3a56ad-375e-409c-b158-65770c70fbed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb342677994f14bebfd6ce6d2e7c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:11Z,use_quota=True,user_id='fbf1d0ce4e764131bd415d60856a2546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e59fdff-f945-4faf-b5ee-e72070b1b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e59fdff-f945-4faf-b5ee-e72070b1b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25b781c-70ba-4c2c-9e57-e455bf401deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25b781c-70ba-4c2c-9e57-e455bf401deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff3a56ad-375e-409c-b158-65770c70fbed', 'volume_name': 'volume-ff3a56ad-375e-409c-b158-65770c70fbed', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d748e28-fc59-4c14-89cd-37af78927f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d748e28-fc59-4c14-89cd-37af78927f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:11 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f335f3c-fbbe-4429-803b-ce1cc8217cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:11 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Volume ff3a56ad-375e-409c-b158-65770c70fbed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff3a56ad-375e-409c-b158-65770c70fbed', 'volume_size': 1} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3f23692f-acd8-4578-b65c-0b239b75a650" returned: 0 in 0.489s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1535944428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b9c1d6-6855-47b6-84db-e8e0e47ace76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb342677994f14bebfd6ce6d2e7c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:10Z,use_quota=True,user_id='fbf1d0ce4e764131bd415d60856a2546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Creating volume 62b9c1d6-6855-47b6-84db-e8e0e47ace76 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:11 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47350485-62a1-44ae-bdb4-ee4cb2bdcc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f23692f-acd8-4578-b65c-0b239b75a650', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ad0031-ee2a-4379-a026-8846230d44f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:11 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76 1073741824 Sep 21 16:44:11 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:11 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Volume volume-3f23692f-acd8-4578-b65c-0b239b75a650 (3f23692f-acd8-4578-b65c-0b239b75a650): created successfully Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ad0031-ee2a-4379-a026-8846230d44f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Flow 'volume_create_manager' (11a7c777-74af-43a9-8187-af552557af0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:11 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e6733ad4-9d17-423b-87dc-878524c723f7 tempest-VolumesActionsTest-1580925557 None] Created volume successfully. Sep 21 16:44:11 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76 1073741824" returned: 0 in 0.578s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:12 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76 Sep 21 16:44:12 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:12 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76" returned: 0 in 0.318s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1592667256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3a56ad-375e-409c-b158-65770c70fbed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bfb342677994f14bebfd6ce6d2e7c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:11Z,use_quota=True,user_id='fbf1d0ce4e764131bd415d60856a2546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Creating volume ff3a56ad-375e-409c-b158-65770c70fbed {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:12 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ff3a56ad-375e-409c-b158-65770c70fbed 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb644d3-f356-4b2c-8f57-14125820ed9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ddff53-e1a3-4536-9216-e692519826b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:12 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ff3a56ad-375e-409c-b158-65770c70fbed 1073741824 Sep 21 16:44:12 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Acquiring lock "cinder-3f23692f-acd8-4578-b65c-0b239b75a650-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:12 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Volume volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76 (62b9c1d6-6855-47b6-84db-e8e0e47ace76): created successfully Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ddff53-e1a3-4536-9216-e692519826b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Flow 'volume_create_manager' (b9a0d791-fee9-4b25-b860-a262dc92e9dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Lock "cinder-3f23692f-acd8-4578-b65c-0b239b75a650-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:12 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-465bc34e-2f88-4f56-a291-ef73adb9658f tempest-TestServerVolumeAttachmentScenario-1993641867 None] Created volume successfully. Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Acquiring lock "cinder-quobyte-3f23692f-acd8-4578-b65c-0b239b75a650" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Lock "cinder-quobyte-3f23692f-acd8-4578-b65c-0b239b75a650" acquired by "delete_volume" :: waited 0.029s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93ff5d5-d277-429e-9ec5-106aa192fd96]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3f23692f-acd8-4578-b65c-0b239b75a650 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:12 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3f23692f-acd8-4578-b65c-0b239b75a650 Sep 21 16:44:12 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:13 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ff3a56ad-375e-409c-b158-65770c70fbed 1073741824" returned: 0 in 0.757s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:13 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3f23692f-acd8-4578-b65c-0b239b75a650" returned: 0 in 0.530s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3f23692f-acd8-4578-b65c-0b239b75a650 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ff3a56ad-375e-409c-b158-65770c70fbed {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:13 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3f23692f-acd8-4578-b65c-0b239b75a650 Sep 21 16:44:13 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:13 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ff3a56ad-375e-409c-b158-65770c70fbed Sep 21 16:44:13 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:13 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3f23692f-acd8-4578-b65c-0b239b75a650" returned: 0 in 0.329s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Lock "cinder-quobyte-3f23692f-acd8-4578-b65c-0b239b75a650" released by "delete_volume" :: held 0.940s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Created reservations ['0d2cc952-d07a-4d29-8ec8-4b0c1c4f15d1', 'f916dc2b-6c2d-4b65-88aa-76e383972d43', 'd3aa0917-4506-4c82-857f-7389a34c741c', 'b7ea6403-3b66-49a8-a9fa-30ad94806af0'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:13 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ff3a56ad-375e-409c-b158-65770c70fbed" returned: 0 in 0.431s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f335f3c-fbbe-4429-803b-ce1cc8217cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff3a56ad-375e-409c-b158-65770c70fbed', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd91a761-fb84-4319-a9fa-3acb2c9f6005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:13 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Volume volume-ff3a56ad-375e-409c-b158-65770c70fbed (ff3a56ad-375e-409c-b158-65770c70fbed): created successfully Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd91a761-fb84-4319-a9fa-3acb2c9f6005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Flow 'volume_create_manager' (12e361f5-6214-48c3-b0d3-7c21199a66cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:13 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-bb214435-b153-4b64-a6f1-fd7ca65e6c5e tempest-TestServerVolumeAttachmentScenario-1993641867 None] Created volume successfully. Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:13 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:13 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:14 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.305s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:14 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:14 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Deleted volume successfully. Sep 21 16:44:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8fcadc2c-39c5-45fb-ab7c-7e66a4f9850c tempest-VolumesActionsTest-998980453 None] Lock "cinder-3f23692f-acd8-4578-b65c-0b239b75a650-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Flow 'volume_create_manager' (f193b1b8-ca89-4aa5-9a15-67253d7eabd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8f93d8-49b6-42ea-9e4f-62d4945ae7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8f93d8-49b6-42ea-9e4f-62d4945ae7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1771778182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a354df6-4e83-401f-b8ec-a82433febd16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bc8d90a0f4bab81cc7fc941d180c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:15Z,use_quota=True,user_id='e4f7ed354a474725bb6339d8cfe5d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e254b12-cdf6-40ba-aa86-d3d92d91bbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e254b12-cdf6-40ba-aa86-d3d92d91bbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03922c18-d222-4382-823a-df8598efed75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03922c18-d222-4382-823a-df8598efed75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a354df6-4e83-401f-b8ec-a82433febd16', 'volume_name': 'volume-6a354df6-4e83-401f-b8ec-a82433febd16', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1224fce-c71d-498d-86e4-c60c8e5a7dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1224fce-c71d-498d-86e4-c60c8e5a7dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2bd1aa-6362-4603-b0a0-901456c6ae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:15 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Volume 6a354df6-4e83-401f-b8ec-a82433febd16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a354df6-4e83-401f-b8ec-a82433febd16', 'volume_size': 1} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1771778182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a354df6-4e83-401f-b8ec-a82433febd16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bc8d90a0f4bab81cc7fc941d180c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:15Z,use_quota=True,user_id='e4f7ed354a474725bb6339d8cfe5d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Creating volume 6a354df6-4e83-401f-b8ec-a82433febd16 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:15 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6a354df6-4e83-401f-b8ec-a82433febd16 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:15 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6a354df6-4e83-401f-b8ec-a82433febd16 1073741824 Sep 21 16:44:15 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:16 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6a354df6-4e83-401f-b8ec-a82433febd16 1073741824" returned: 0 in 0.685s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6a354df6-4e83-401f-b8ec-a82433febd16 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:16 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6a354df6-4e83-401f-b8ec-a82433febd16 Sep 21 16:44:16 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:16 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6a354df6-4e83-401f-b8ec-a82433febd16" returned: 0 in 0.296s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2bd1aa-6362-4603-b0a0-901456c6ae19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a354df6-4e83-401f-b8ec-a82433febd16', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8791abd-356c-4bcb-ad0e-910b52ec2410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:16 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Volume volume-6a354df6-4e83-401f-b8ec-a82433febd16 (6a354df6-4e83-401f-b8ec-a82433febd16): created successfully Sep 21 16:44:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8791abd-356c-4bcb-ad0e-910b52ec2410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Flow 'volume_create_manager' (f193b1b8-ca89-4aa5-9a15-67253d7eabd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:16 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a700b7e9-1a57-487f-96d6-a1658bb67245 tempest-VolumesActionsTest-1580925557 None] Created volume successfully. Sep 21 16:44:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Acquiring lock "cinder-6a354df6-4e83-401f-b8ec-a82433febd16-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Lock "cinder-6a354df6-4e83-401f-b8ec-a82433febd16-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Acquiring lock "cinder-quobyte-6a354df6-4e83-401f-b8ec-a82433febd16" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Lock "cinder-quobyte-6a354df6-4e83-401f-b8ec-a82433febd16" acquired by "delete_volume" :: waited 0.029s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:17 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af2b515-6ba2-4833-9d2f-a7d76dd5906c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6a354df6-4e83-401f-b8ec-a82433febd16 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:18 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6a354df6-4e83-401f-b8ec-a82433febd16 Sep 21 16:44:18 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:18 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6a354df6-4e83-401f-b8ec-a82433febd16" returned: 0 in 0.607s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6a354df6-4e83-401f-b8ec-a82433febd16 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:18 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6a354df6-4e83-401f-b8ec-a82433febd16 Sep 21 16:44:18 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:18 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6a354df6-4e83-401f-b8ec-a82433febd16" returned: 0 in 0.358s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Lock "cinder-quobyte-6a354df6-4e83-401f-b8ec-a82433febd16" released by "delete_volume" :: held 1.031s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:18 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Created reservations ['de093b7a-80c4-4209-a483-a418bec6f9ed', 'e535e4d5-0087-4c71-9a0b-d468e15fb2c2', '9afadfdf-cb3c-4fa2-9431-3b57db1d1b3e', 'e935aef1-348d-4015-991c-31b8ba741040'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:19 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:19 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:19 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.424s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:19 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:19 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Deleted volume successfully. Sep 21 16:44:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-324c579a-6d82-4d39-bec0-8c5047a1866c tempest-VolumesActionsTest-998980453 None] Lock "cinder-6a354df6-4e83-401f-b8ec-a82433febd16-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:20 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Flow 'volume_create_manager' (a4a5f28d-03a0-4cd6-be79-6056467c4a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a267992-96cc-42e2-a98c-4b20f628bd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a267992-96cc-42e2-a98c-4b20f628bd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-537231727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d4994a-d7a5-42f7-8c33-9248e0a3e2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bc8d90a0f4bab81cc7fc941d180c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:21Z,use_quota=True,user_id='e4f7ed354a474725bb6339d8cfe5d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f002ad74-1388-4d1b-accd-be88a45fa90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f002ad74-1388-4d1b-accd-be88a45fa90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7bc1242-7812-46c9-b76b-4586f2ce467b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7bc1242-7812-46c9-b76b-4586f2ce467b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19d4994a-d7a5-42f7-8c33-9248e0a3e2b4', 'volume_name': 'volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4bc945e-047c-4a9d-91a4-adf071c34815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4bc945e-047c-4a9d-91a4-adf071c34815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bcca09-1826-4425-81ba-584887e0ef5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:21 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Volume 19d4994a-d7a5-42f7-8c33-9248e0a3e2b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4', 'volume_size': 1} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-537231727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d4994a-d7a5-42f7-8c33-9248e0a3e2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1bc8d90a0f4bab81cc7fc941d180c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:21Z,use_quota=True,user_id='e4f7ed354a474725bb6339d8cfe5d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Creating volume 19d4994a-d7a5-42f7-8c33-9248e0a3e2b4 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:21 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:21 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4 1073741824 Sep 21 16:44:21 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:21 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4 1073741824" returned: 0 in 0.680s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:21 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4 Sep 21 16:44:21 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:22 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4" returned: 0 in 0.384s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bcca09-1826-4425-81ba-584887e0ef5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9261129b-0083-4ee9-bdbc-ffb31263d054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:22 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Volume volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4 (19d4994a-d7a5-42f7-8c33-9248e0a3e2b4): created successfully Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9261129b-0083-4ee9-bdbc-ffb31263d054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Flow 'volume_create_manager' (a4a5f28d-03a0-4cd6-be79-6056467c4a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:22 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b22a0721-0b02-4f3b-8231-39823c370d4e tempest-VolumesActionsTest-1580925557 None] Created volume successfully. Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Flow 'volume_create_manager' (7ab3c5c6-72cc-44a9-8adb-5901db5f6c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f12901d-e0bd-43a1-9f61-e70092f50eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f12901d-e0bd-43a1-9f61-e70092f50eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1889034073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64507dd-3378-456c-a3b5-58b69c68c25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97fdbbd2df1443aa9b0653d032665cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:22Z,use_quota=True,user_id='b8183e9751c94800927cfd3fee884174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (440fba09-9989-4deb-95f6-aceb89c5448a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (440fba09-9989-4deb-95f6-aceb89c5448a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b74ad1-c0bb-449c-a583-43940a35234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b74ad1-c0bb-449c-a583-43940a35234d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64507dd-3378-456c-a3b5-58b69c68c25a', 'volume_name': 'volume-b64507dd-3378-456c-a3b5-58b69c68c25a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d490d3a9-70be-4c60-aa4f-138044457249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d490d3a9-70be-4c60-aa4f-138044457249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a1382e-82c9-49fc-a0a6-6196f4548817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:22 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume b64507dd-3378-456c-a3b5-58b69c68c25a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64507dd-3378-456c-a3b5-58b69c68c25a', 'volume_size': 1} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1889034073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64507dd-3378-456c-a3b5-58b69c68c25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97fdbbd2df1443aa9b0653d032665cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:22Z,use_quota=True,user_id='b8183e9751c94800927cfd3fee884174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Creating volume b64507dd-3378-456c-a3b5-58b69c68c25a {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:22 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:22 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a 1073741824 Sep 21 16:44:22 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:23 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a 1073741824" returned: 0 in 0.902s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:23 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a Sep 21 16:44:23 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:24 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a" returned: 0 in 0.526s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a1382e-82c9-49fc-a0a6-6196f4548817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64507dd-3378-456c-a3b5-58b69c68c25a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ec6bdd-26a7-44f5-8f73-0e519ed6331d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:24 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume volume-b64507dd-3378-456c-a3b5-58b69c68c25a (b64507dd-3378-456c-a3b5-58b69c68c25a): created successfully Sep 21 16:44:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ec6bdd-26a7-44f5-8f73-0e519ed6331d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Flow 'volume_create_manager' (7ab3c5c6-72cc-44a9-8adb-5901db5f6c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:24 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8dea6506-e486-458e-a0f5-e890e54802c2 tempest-CreateVolumesFromSnapshotTest-654620845 None] Created volume successfully. Sep 21 16:44:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Acquiring lock "cinder-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Lock "cinder-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Acquiring lock "cinder-quobyte-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Lock "cinder-quobyte-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:24 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d85ad4-b1e5-46b6-9f45-a32134edbc65]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] Creating offline snapshot 73da10ae-35e0-4c10-bc27-3595f3a17ebc of volume b64507dd-3378-456c-a3b5-58b69c68c25a {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:44:25 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4 Sep 21 16:44:25 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:25 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaec8229-fac8-45f1-a582-0fa9fec3cebb]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:25 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a Sep 21 16:44:25 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:25 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4" returned: 0 in 0.641s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:25 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4 Sep 21 16:44:25 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:25 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a" returned: 0 in 0.570s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:25 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc 1G Sep 21 16:44:25 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:26 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4" returned: 0 in 0.480s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Lock "cinder-quobyte-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4" released by "delete_volume" :: held 1.267s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Created reservations ['caf0808e-e9db-469f-ac28-83140393708c', '3f8e0eaf-dbbf-4e57-a45e-6ebb1f714f3a', '361b1156-d1db-4028-b28d-baa3d526395a', '0b8bec23-7be3-4a99-b2cf-2d2d82c6d671'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:26 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:26 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:26 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc 1G" returned: 0 in 0.659s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b64507dd-3378-456c-a3b5-58b69c68c25a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:26 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b64507dd-3378-456c-a3b5-58b69c68c25a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc Sep 21 16:44:26 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:26 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.453s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Deleted volume successfully. Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7dda3983-a33c-4927-a85a-47e46618ce6d tempest-VolumesActionsTest-1580925557 None] Lock "cinder-19d4994a-d7a5-42f7-8c33-9248e0a3e2b4-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:26 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b64507dd-3378-456c-a3b5-58b69c68c25a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc" returned: 0 in 0.467s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:26 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc is being set with open permissions: ugo+rw Sep 21 16:44:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:26 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc Sep 21 16:44:26 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:27 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc" returned: 0 in 0.453s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:27 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.info Sep 21 16:44:27 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:27 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.info" returned: 0 in 0.545s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:28 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.info is being set with open permissions: ugo+rw Sep 21 16:44:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:28 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.info Sep 21 16:44:28 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:28 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.info" returned: 0 in 0.521s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.440s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:28 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ddca856a-3526-4862-9de8-5518a7f0b14e tempest-CreateVolumesFromSnapshotTest-654620845 None] Create snapshot completed successfully Sep 21 16:44:29 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Flow 'volume_create_manager' (aa2cbfd5-132d-45de-9859-f28aa7dccbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1495cf1e-b376-4439-83d2-546a56da72bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1495cf1e-b376-4439-83d2-546a56da72bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1720476696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ffd85a6-3436-4f43-bf48-4d8364ea6a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cca746c26b94309a509f5de5b362977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:30Z,use_quota=True,user_id='aa3dcb082f2b448c90a3bd9d768a149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a59eec-3e68-4760-a21f-3b86570e4fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a59eec-3e68-4760-a21f-3b86570e4fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c303253-e3c0-479a-b2cc-ed3205428a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c303253-e3c0-479a-b2cc-ed3205428a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ffd85a6-3436-4f43-bf48-4d8364ea6a0b', 'volume_name': 'volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc36940-198a-4529-a9b5-e1c9c47986f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc36940-198a-4529-a9b5-e1c9c47986f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e4901e-272b-4c9f-afe2-3972f84358fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:30 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Volume 5ffd85a6-3436-4f43-bf48-4d8364ea6a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b', 'volume_size': 1} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1720476696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ffd85a6-3436-4f43-bf48-4d8364ea6a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cca746c26b94309a509f5de5b362977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:30Z,use_quota=True,user_id='aa3dcb082f2b448c90a3bd9d768a149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Creating volume 5ffd85a6-3436-4f43-bf48-4d8364ea6a0b {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:30 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:30 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b 1073741824 Sep 21 16:44:30 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Flow 'volume_create_manager' (dccc4b03-421c-4842-a53c-f9fa0d3ee235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde25fb9-8f80-42aa-a0ff-d28232101e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde25fb9-8f80-42aa-a0ff-d28232101e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1222663420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2258d0a7-8281-4b70-a46c-1321711dc91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97fdbbd2df1443aa9b0653d032665cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:30Z,use_quota=True,user_id='b8183e9751c94800927cfd3fee884174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd8ac4e-52dc-4e75-96f7-9cced255592c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd8ac4e-52dc-4e75-96f7-9cced255592c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96aa734b-af3e-427c-97f1-33d21a044005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96aa734b-af3e-427c-97f1-33d21a044005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2258d0a7-8281-4b70-a46c-1321711dc91c', 'volume_name': 'volume-2258d0a7-8281-4b70-a46c-1321711dc91c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ee2dea-8158-4e8a-aeb0-d05369372869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ee2dea-8158-4e8a-aeb0-d05369372869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2bf856-d7a5-4fd6-9cd0-02e0e10e0b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:30 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume 2258d0a7-8281-4b70-a46c-1321711dc91c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2258d0a7-8281-4b70-a46c-1321711dc91c', 'volume_size': 1} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:30 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b 1073741824" returned: 0 in 0.705s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:30 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b Sep 21 16:44:30 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Flow 'volume_create_manager' (e7639361-566f-4724-ac08-81eded4bae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daca4651-ddcc-4f69-a11f-87c88409e90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daca4651-ddcc-4f69-a11f-87c88409e90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571113643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3b0de1-dcb3-4152-b91f-046fe6c255ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97fdbbd2df1443aa9b0653d032665cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:31Z,use_quota=True,user_id='b8183e9751c94800927cfd3fee884174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e87bea-6570-4eb2-aed6-d4955c866d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e87bea-6570-4eb2-aed6-d4955c866d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75867f66-1dbb-48af-99a3-5513b27af466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75867f66-1dbb-48af-99a3-5513b27af466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3b0de1-dcb3-4152-b91f-046fe6c255ef', 'volume_name': 'volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc15741-1517-4ae5-8ddf-d752c75a0d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc15741-1517-4ae5-8ddf-d752c75a0d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cfb82cd-5236-400f-95fd-fa11f025ad7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:31 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume 2c3b0de1-dcb3-4152-b91f-046fe6c255ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef', 'volume_size': 1} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:31 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b" returned: 0 in 0.392s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1222663420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2258d0a7-8281-4b70-a46c-1321711dc91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97fdbbd2df1443aa9b0653d032665cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:30Z,use_quota=True,user_id='b8183e9751c94800927cfd3fee884174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Creating volume 2258d0a7-8281-4b70-a46c-1321711dc91c {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:31 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2258d0a7-8281-4b70-a46c-1321711dc91c 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=138,cinder:SELECT=103,cinder:DELETE=16,cinder:INSERT=29 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e4901e-272b-4c9f-afe2-3972f84358fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:31 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2258d0a7-8281-4b70-a46c-1321711dc91c 1073741824 Sep 21 16:44:31 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94a1e11-c18c-42dd-b97e-8233b7da63bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:31 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Volume volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b (5ffd85a6-3436-4f43-bf48-4d8364ea6a0b): created successfully Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94a1e11-c18c-42dd-b97e-8233b7da63bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Flow 'volume_create_manager' (aa2cbfd5-132d-45de-9859-f28aa7dccbc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:31 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-bf35d976-36b1-4c4e-b88a-a0c332cf772f tempest-VolumesListAdminTestJSON-307843753 None] Created volume successfully. Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=109,cinder:INSERT=28,cinder:UPDATE=131,cinder:DELETE=9 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Flow 'volume_create_manager' (7048b1b1-8ea1-4fcd-b11b-0209b719f256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4e9896-512b-4965-a08c-5fefa5e91fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4e9896-512b-4965-a08c-5fefa5e91fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-40258679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7c9730-dbb7-499f-937c-f327981cf438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97fdbbd2df1443aa9b0653d032665cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:32Z,use_quota=True,user_id='b8183e9751c94800927cfd3fee884174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea62af2c-de11-4c51-8fa5-077eb35d9ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea62af2c-de11-4c51-8fa5-077eb35d9ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05243941-cd04-48b3-9c2c-f2f8d306b9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05243941-cd04-48b3-9c2c-f2f8d306b9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7c9730-dbb7-499f-937c-f327981cf438', 'volume_name': 'volume-8b7c9730-dbb7-499f-937c-f327981cf438', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127952e3-dda6-412e-bd55-c2313e17b2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127952e3-dda6-412e-bd55-c2313e17b2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c90c38-7997-4982-89fd-f1d866bbbb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:31 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume 8b7c9730-dbb7-499f-937c-f327981cf438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7c9730-dbb7-499f-937c-f327981cf438', 'volume_size': 1} Sep 21 16:44:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:32 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2258d0a7-8281-4b70-a46c-1321711dc91c 1073741824" returned: 0 in 0.830s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Flow 'volume_create_manager' (251c68b3-b78b-4b01-a3f9-15e75e06419e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d69f3f3-d954-4759-be94-1d958c0c18ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d69f3f3-d954-4759-be94-1d958c0c18ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587507719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ce6868-a580-42f0-a1fb-34c4c9924abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97fdbbd2df1443aa9b0653d032665cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:32Z,use_quota=True,user_id='b8183e9751c94800927cfd3fee884174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76de731-6f55-4efe-b8df-301578c2e235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76de731-6f55-4efe-b8df-301578c2e235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ae58c4-ad4d-4f99-a9d9-aeb2255dfee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ae58c4-ad4d-4f99-a9d9-aeb2255dfee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ce6868-a580-42f0-a1fb-34c4c9924abd', 'volume_name': 'volume-15ce6868-a580-42f0-a1fb-34c4c9924abd', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f8ba2c-f067-45d4-ad13-637bc879ab4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f8ba2c-f067-45d4-ad13-637bc879ab4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00a6dee-1515-47f4-acd6-329770924bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:32 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume 15ce6868-a580-42f0-a1fb-34c4c9924abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ce6868-a580-42f0-a1fb-34c4c9924abd', 'volume_size': 1} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2258d0a7-8281-4b70-a46c-1321711dc91c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:32 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2258d0a7-8281-4b70-a46c-1321711dc91c Sep 21 16:44:32 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:32 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2258d0a7-8281-4b70-a46c-1321711dc91c" returned: 0 in 0.568s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.790s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571113643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3b0de1-dcb3-4152-b91f-046fe6c255ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97fdbbd2df1443aa9b0653d032665cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:31Z,use_quota=True,user_id='b8183e9751c94800927cfd3fee884174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Creating volume 2c3b0de1-dcb3-4152-b91f-046fe6c255ef {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:32 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2bf856-d7a5-4fd6-9cd0-02e0e10e0b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2258d0a7-8281-4b70-a46c-1321711dc91c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d3cc48-9c66-4eb8-ab30-e6206ff91496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:32 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef 1073741824 Sep 21 16:44:32 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:32 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume volume-2258d0a7-8281-4b70-a46c-1321711dc91c (2258d0a7-8281-4b70-a46c-1321711dc91c): created successfully Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d3cc48-9c66-4eb8-ab30-e6206ff91496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Flow 'volume_create_manager' (dccc4b03-421c-4842-a53c-f9fa0d3ee235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-cbacb6cb-b626-4df6-be52-841a30958b76 tempest-CreateVolumesFromSnapshotTest-654620845 None] Created volume successfully. Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Flow 'volume_create_manager' (8bcabd2d-6103-414e-aaef-316279ae5e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a38cf4-2048-42d2-82c2-51657908a39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a38cf4-2048-42d2-82c2-51657908a39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1090761441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97fdbbd2df1443aa9b0653d032665cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:33Z,use_quota=True,user_id='b8183e9751c94800927cfd3fee884174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bb4010-d4cf-40b6-ae0b-0cfa8766f43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bb4010-d4cf-40b6-ae0b-0cfa8766f43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc57266-4ae9-48b3-9110-21ac33c48fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc57266-4ae9-48b3-9110-21ac33c48fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b', 'volume_name': 'volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7086a107-aba4-4c1a-bd73-3cd6c9ae1b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7086a107-aba4-4c1a-bd73-3cd6c9ae1b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64fa3ff-0216-4183-99b9-08ee3daea885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:33 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume 469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b', 'volume_size': 1} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Flow 'volume_create_manager' (4a15346c-8eee-4955-bb50-5ba6ba9b21ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a90ea0-10e1-4034-9e1a-e2b20dbaf5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:33 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef 1073741824" returned: 0 in 0.653s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a90ea0-10e1-4034-9e1a-e2b20dbaf5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-727336708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ef4ff8-bfba-44d6-b22d-5d4b6800e347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cca746c26b94309a509f5de5b362977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:33Z,use_quota=True,user_id='aa3dcb082f2b448c90a3bd9d768a149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f742aa-4154-4fa5-98d3-e1ef573ee53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f742aa-4154-4fa5-98d3-e1ef573ee53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e388115-f031-4a87-9019-50377a508b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e388115-f031-4a87-9019-50377a508b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9ef4ff8-bfba-44d6-b22d-5d4b6800e347', 'volume_name': 'volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b8147c-c428-400d-85cf-602fe44791ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b8147c-c428-400d-85cf-602fe44791ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c70dafd-d47e-4848-a277-33e75a5a969a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:33 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Volume a9ef4ff8-bfba-44d6-b22d-5d4b6800e347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347', 'volume_size': 1} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:33 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef Sep 21 16:44:33 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:34 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef" returned: 0 in 0.403s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.158s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-40258679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7c9730-dbb7-499f-937c-f327981cf438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97fdbbd2df1443aa9b0653d032665cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:32Z,use_quota=True,user_id='b8183e9751c94800927cfd3fee884174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Creating volume 8b7c9730-dbb7-499f-937c-f327981cf438 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:34 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8b7c9730-dbb7-499f-937c-f327981cf438 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cfb82cd-5236-400f-95fd-fa11f025ad7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1016c466-f76f-4fd7-a2fb-9f099d21de50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:34 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8b7c9730-dbb7-499f-937c-f327981cf438 1073741824 Sep 21 16:44:34 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:34 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef (2c3b0de1-dcb3-4152-b91f-046fe6c255ef): created successfully Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1016c466-f76f-4fd7-a2fb-9f099d21de50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Flow 'volume_create_manager' (e7639361-566f-4724-ac08-81eded4bae99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:34 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-61ee274c-a644-42d1-95fd-5acf11f35f61 tempest-CreateVolumesFromSnapshotTest-654620845 None] Created volume successfully. Sep 21 16:44:34 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8b7c9730-dbb7-499f-937c-f327981cf438 1073741824" returned: 0 in 0.525s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8b7c9730-dbb7-499f-937c-f327981cf438 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:34 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8b7c9730-dbb7-499f-937c-f327981cf438 Sep 21 16:44:34 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:34 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8b7c9730-dbb7-499f-937c-f327981cf438" returned: 0 in 0.246s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.671s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587507719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ce6868-a580-42f0-a1fb-34c4c9924abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97fdbbd2df1443aa9b0653d032665cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:32Z,use_quota=True,user_id='b8183e9751c94800927cfd3fee884174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Creating volume 15ce6868-a580-42f0-a1fb-34c4c9924abd {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:34 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15ce6868-a580-42f0-a1fb-34c4c9924abd 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c90c38-7997-4982-89fd-f1d866bbbb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7c9730-dbb7-499f-937c-f327981cf438', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3ebe00-5cf5-44c3-94ef-22a8e5d90b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:34 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15ce6868-a580-42f0-a1fb-34c4c9924abd 1073741824 Sep 21 16:44:34 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:34 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume volume-8b7c9730-dbb7-499f-937c-f327981cf438 (8b7c9730-dbb7-499f-937c-f327981cf438): created successfully Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3ebe00-5cf5-44c3-94ef-22a8e5d90b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Flow 'volume_create_manager' (7048b1b1-8ea1-4fcd-b11b-0209b719f256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:35 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ee1ab38b-4b0e-4b86-9263-518057c16ccc tempest-CreateVolumesFromSnapshotTest-654620845 None] Created volume successfully. Sep 21 16:44:35 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15ce6868-a580-42f0-a1fb-34c4c9924abd 1073741824" returned: 0 in 0.581s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15ce6868-a580-42f0-a1fb-34c4c9924abd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:35 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15ce6868-a580-42f0-a1fb-34c4c9924abd Sep 21 16:44:35 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:35 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15ce6868-a580-42f0-a1fb-34c4c9924abd" returned: 0 in 0.258s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.300s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1090761441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97fdbbd2df1443aa9b0653d032665cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:33Z,use_quota=True,user_id='b8183e9751c94800927cfd3fee884174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Creating volume 469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:35 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00a6dee-1515-47f4-acd6-329770924bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ce6868-a580-42f0-a1fb-34c4c9924abd', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:35 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b 1073741824 Sep 21 16:44:35 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef5a662-ff59-4e46-85cb-0b3b420b91e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:35 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume volume-15ce6868-a580-42f0-a1fb-34c4c9924abd (15ce6868-a580-42f0-a1fb-34c4c9924abd): created successfully Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef5a662-ff59-4e46-85cb-0b3b420b91e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Flow 'volume_create_manager' (251c68b3-b78b-4b01-a3f9-15e75e06419e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:35 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e86fa15f-7b6f-4e6c-b304-7416b85b8f65 tempest-CreateVolumesFromSnapshotTest-654620845 None] Created volume successfully. Sep 21 16:44:36 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b 1073741824" returned: 0 in 0.561s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:36 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b Sep 21 16:44:36 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:36 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b" returned: 0 in 0.294s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.120s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-727336708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ef4ff8-bfba-44d6-b22d-5d4b6800e347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cca746c26b94309a509f5de5b362977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:33Z,use_quota=True,user_id='aa3dcb082f2b448c90a3bd9d768a149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Creating volume a9ef4ff8-bfba-44d6-b22d-5d4b6800e347 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:36 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64fa3ff-0216-4183-99b9-08ee3daea885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:36 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347 1073741824 Sep 21 16:44:36 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb27412b-5cb7-49d3-99f9-9fb3bbdb40df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:36 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Volume volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b (469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b): created successfully Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb27412b-5cb7-49d3-99f9-9fb3bbdb40df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Flow 'volume_create_manager' (8bcabd2d-6103-414e-aaef-316279ae5e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:36 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-994d3933-4f20-422c-b162-33fbe42f08ae tempest-CreateVolumesFromSnapshotTest-654620845 None] Created volume successfully. Sep 21 16:44:37 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347 1073741824" returned: 0 in 0.482s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:37 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347 Sep 21 16:44:37 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:37 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347" returned: 0 in 0.275s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c70dafd-d47e-4848-a277-33e75a5a969a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96aeab22-6f8b-4fd8-950e-45ddde98185b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:37 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Volume volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347 (a9ef4ff8-bfba-44d6-b22d-5d4b6800e347): created successfully Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96aeab22-6f8b-4fd8-950e-45ddde98185b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Flow 'volume_create_manager' (4a15346c-8eee-4955-bb50-5ba6ba9b21ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:37 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e1dd5c88-b6ae-4408-a0e6-dbfcf409acb8 tempest-VolumesListAdminTestJSON-307843753 None] Created volume successfully. Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-quobyte-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b" acquired by "delete_volume" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[feae2868-61de-40c9-a513-0e250c7175f2]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:37 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b Sep 21 16:44:37 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:38 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b" returned: 0 in 0.521s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:38 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b Sep 21 16:44:38 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:38 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b" returned: 0 in 0.310s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b" released by "delete_volume" :: held 0.883s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Created reservations ['499a8934-65f4-45dc-abe6-b4272d863909', '62064691-a0e8-4691-b77c-c9fc9a919ee7', 'a2b7945e-db6e-441f-a913-f67434f2d212', '4ac10dc5-5c5c-45c1-be1a-f40dc242e0bb'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:38 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:38 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-15ce6868-a580-42f0-a1fb-34c4c9924abd-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-15ce6868-a580-42f0-a1fb-34c4c9924abd-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-quobyte-15ce6868-a580-42f0-a1fb-34c4c9924abd" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-15ce6868-a580-42f0-a1fb-34c4c9924abd" acquired by "delete_volume" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a7aa15-a4ff-419b-a68e-3d4608e07bd3]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15ce6868-a580-42f0-a1fb-34c4c9924abd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:39 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Flow 'volume_create_manager' (03cafdec-0f85-47eb-8d7b-eacb0cb3f5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6697257-5379-438e-8cc6-acacf823fa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.473s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:39 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15ce6868-a580-42f0-a1fb-34c4c9924abd Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:39 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:39 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Deleted volume successfully. Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6697257-5379-438e-8cc6-acacf823fa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1603267454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243df5c7-80b6-4b1b-81e4-57916744ee5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cca746c26b94309a509f5de5b362977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:39Z,use_quota=True,user_id='aa3dcb082f2b448c90a3bd9d768a149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68020e36-67ba-435f-b0d1-769c0ab7d76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68020e36-67ba-435f-b0d1-769c0ab7d76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe23bce-b703-41f6-9d6b-3454081c8fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe23bce-b703-41f6-9d6b-3454081c8fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243df5c7-80b6-4b1b-81e4-57916744ee5a', 'volume_name': 'volume-243df5c7-80b6-4b1b-81e4-57916744ee5a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62788350-a94d-4929-94cb-ce30b41a3ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62788350-a94d-4929-94cb-ce30b41a3ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f787005-b9f8-4912-a707-bbd2eba0da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:39 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Volume 243df5c7-80b6-4b1b-81e4-57916744ee5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243df5c7-80b6-4b1b-81e4-57916744ee5a', 'volume_size': 1} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1603267454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243df5c7-80b6-4b1b-81e4-57916744ee5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cca746c26b94309a509f5de5b362977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:39Z,use_quota=True,user_id='aa3dcb082f2b448c90a3bd9d768a149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Creating volume 243df5c7-80b6-4b1b-81e4-57916744ee5a {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:39 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-243df5c7-80b6-4b1b-81e4-57916744ee5a 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-70d79dab-7d4b-4c96-baec-8e3adc4b0cbf tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-469a4880-f3a9-43f4-a9f5-d5fa49fd7e6b-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:39 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-243df5c7-80b6-4b1b-81e4-57916744ee5a 1073741824 Sep 21 16:44:39 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:39 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15ce6868-a580-42f0-a1fb-34c4c9924abd" returned: 0 in 0.525s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15ce6868-a580-42f0-a1fb-34c4c9924abd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:39 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15ce6868-a580-42f0-a1fb-34c4c9924abd Sep 21 16:44:39 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:39 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-243df5c7-80b6-4b1b-81e4-57916744ee5a 1073741824" returned: 0 in 0.523s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:39 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15ce6868-a580-42f0-a1fb-34c4c9924abd" returned: 0 in 0.321s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-243df5c7-80b6-4b1b-81e4-57916744ee5a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-15ce6868-a580-42f0-a1fb-34c4c9924abd" released by "delete_volume" :: held 0.919s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:39 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-243df5c7-80b6-4b1b-81e4-57916744ee5a Sep 21 16:44:39 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:39 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Created reservations ['17a1b7f1-3a59-4204-9c61-b83f392e97b1', '0c235498-fdb5-420a-baea-844b8ed428b9', '4e71fc88-72cc-4787-b444-efdd917f0b63', '9f4a62ec-aa90-4c00-83dd-86ce3b116061'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-8b7c9730-dbb7-499f-937c-f327981cf438-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:40 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:40 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-8b7c9730-dbb7-499f-937c-f327981cf438-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:40 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-243df5c7-80b6-4b1b-81e4-57916744ee5a" returned: 0 in 0.313s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f787005-b9f8-4912-a707-bbd2eba0da00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243df5c7-80b6-4b1b-81e4-57916744ee5a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2485ceeb-c1c3-45e5-bc00-88017ed64364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:40 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Volume volume-243df5c7-80b6-4b1b-81e4-57916744ee5a (243df5c7-80b6-4b1b-81e4-57916744ee5a): created successfully Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2485ceeb-c1c3-45e5-bc00-88017ed64364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Flow 'volume_create_manager' (03cafdec-0f85-47eb-8d7b-eacb0cb3f5c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-quobyte-8b7c9730-dbb7-499f-937c-f327981cf438" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:40 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6352c72a-ada4-4c03-b0fc-08be9ed1513c tempest-VolumesListAdminTestJSON-307843753 None] Created volume successfully. Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-8b7c9730-dbb7-499f-937c-f327981cf438" acquired by "delete_volume" :: waited 0.031s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0779ad0-a3fb-4337-a251-a898229ceb91]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8b7c9730-dbb7-499f-937c-f327981cf438 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:40 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.321s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:40 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Deleted volume successfully. Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dc3828a7-24f7-4aac-b7f3-4f1a001e3653 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-15ce6868-a580-42f0-a1fb-34c4c9924abd-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:40 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8b7c9730-dbb7-499f-937c-f327981cf438 Sep 21 16:44:40 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:40 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8b7c9730-dbb7-499f-937c-f327981cf438" returned: 0 in 0.416s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8b7c9730-dbb7-499f-937c-f327981cf438 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:40 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8b7c9730-dbb7-499f-937c-f327981cf438 Sep 21 16:44:40 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:41 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8b7c9730-dbb7-499f-937c-f327981cf438" returned: 0 in 0.254s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-8b7c9730-dbb7-499f-937c-f327981cf438" released by "delete_volume" :: held 0.726s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Created reservations ['216f9071-ba55-4d69-b12a-e221af991578', '64ba9bfd-471a-4195-9f33-cb35ef6ea9ff', '16f3f8c8-e27d-4d03-9dad-d6f9ffa423ba', '0de77aae-3f8f-4298-9adc-636acd4b3abd'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:41 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:41 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-2c3b0de1-dcb3-4152-b91f-046fe6c255ef-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-2c3b0de1-dcb3-4152-b91f-046fe6c255ef-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-quobyte-2c3b0de1-dcb3-4152-b91f-046fe6c255ef" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-2c3b0de1-dcb3-4152-b91f-046fe6c255ef" acquired by "delete_volume" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c981ee1-b68b-4954-8ca5-ba264fabed54]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:41 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.329s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:41 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Deleted volume successfully. Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-48326613-1cd8-4d4d-9128-8afa4c920c3c tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-8b7c9730-dbb7-499f-937c-f327981cf438-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:41 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef Sep 21 16:44:41 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:41 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef" returned: 0 in 0.444s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:41 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef Sep 21 16:44:41 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:42 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2c3b0de1-dcb3-4152-b91f-046fe6c255ef" returned: 0 in 0.290s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-2c3b0de1-dcb3-4152-b91f-046fe6c255ef" released by "delete_volume" :: held 0.793s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Flow 'volume_create_manager' (2c2c9893-e2dd-4f0b-966f-8d1a6ac3ee9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594d1ad6-c585-4bb9-acc9-5a92276eb620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Created reservations ['04a515a7-d028-4adc-a7c7-cbd4332c0488', '3283c934-95a4-468e-9dd8-d00a03916a3d', 'cadfdcc5-d7ba-4da0-9c81-813de53fc14a', '8383bad8-7f5e-4224-9655-c1d62a2d7700'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594d1ad6-c585-4bb9-acc9-5a92276eb620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860cac39-b826-4fdd-a778-2176e6bd0add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a141e56f66484112bfd0a3ca668e80ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:42Z,use_quota=True,user_id='6faf2e9b57ec4833ad86f42b0a75110f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ecfe5e-b1cf-4139-926d-9454114dcfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ecfe5e-b1cf-4139-926d-9454114dcfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05833daa-afff-413e-b82e-05987114b501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05833daa-afff-413e-b82e-05987114b501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '860cac39-b826-4fdd-a778-2176e6bd0add', 'volume_name': 'volume-860cac39-b826-4fdd-a778-2176e6bd0add', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1900505-02bc-4d56-bc0f-bd6dc57b5677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1900505-02bc-4d56-bc0f-bd6dc57b5677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df6c568-0c50-497e-a993-5bc152f58d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:42 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Volume 860cac39-b826-4fdd-a778-2176e6bd0add: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-860cac39-b826-4fdd-a778-2176e6bd0add', 'volume_size': 1} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860cac39-b826-4fdd-a778-2176e6bd0add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a141e56f66484112bfd0a3ca668e80ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:42Z,use_quota=True,user_id='6faf2e9b57ec4833ad86f42b0a75110f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Creating volume 860cac39-b826-4fdd-a778-2176e6bd0add {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:42 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-860cac39-b826-4fdd-a778-2176e6bd0add 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:42 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-860cac39-b826-4fdd-a778-2176e6bd0add 1073741824 Sep 21 16:44:42 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:42 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:42 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-2258d0a7-8281-4b70-a46c-1321711dc91c-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-2258d0a7-8281-4b70-a46c-1321711dc91c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-quobyte-2258d0a7-8281-4b70-a46c-1321711dc91c" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-2258d0a7-8281-4b70-a46c-1321711dc91c" acquired by "delete_volume" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9b0b9a-1405-44f2-9c05-3aa0f4cf68de]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2258d0a7-8281-4b70-a46c-1321711dc91c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:42 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.349s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:42 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Deleted volume successfully. Sep 21 16:44:42 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2258d0a7-8281-4b70-a46c-1321711dc91c Sep 21 16:44:42 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d4db472b-d0be-463c-9391-2114b52e85e9 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-2c3b0de1-dcb3-4152-b91f-046fe6c255ef-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:42 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-860cac39-b826-4fdd-a778-2176e6bd0add 1073741824" returned: 0 in 0.606s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-860cac39-b826-4fdd-a778-2176e6bd0add {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:43 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-860cac39-b826-4fdd-a778-2176e6bd0add Sep 21 16:44:43 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:43 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2258d0a7-8281-4b70-a46c-1321711dc91c" returned: 0 in 0.452s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2258d0a7-8281-4b70-a46c-1321711dc91c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:43 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2258d0a7-8281-4b70-a46c-1321711dc91c Sep 21 16:44:43 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:43 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-860cac39-b826-4fdd-a778-2176e6bd0add" returned: 0 in 0.279s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df6c568-0c50-497e-a993-5bc152f58d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-860cac39-b826-4fdd-a778-2176e6bd0add', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffaf566-2b9f-4dea-84a5-3279480c78d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:43 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Volume volume-860cac39-b826-4fdd-a778-2176e6bd0add (860cac39-b826-4fdd-a778-2176e6bd0add): created successfully Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffaf566-2b9f-4dea-84a5-3279480c78d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Flow 'volume_create_manager' (2c2c9893-e2dd-4f0b-966f-8d1a6ac3ee9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-36225ee1-3ece-4baa-9148-1055f4dc3a04 tempest-VolumesListAdminTestJSON-784005182 None] Created volume successfully. Sep 21 16:44:43 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2258d0a7-8281-4b70-a46c-1321711dc91c" returned: 0 in 0.291s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-2258d0a7-8281-4b70-a46c-1321711dc91c" released by "delete_volume" :: held 0.803s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Created reservations ['f8c25364-0019-41fc-9e87-49589edf35d0', 'f076d5b1-f110-4640-bed0-bcd0d8a2d274', '0f31923a-324d-41a1-84b8-0ab42e9c6927', '2aa7ccd5-a185-41aa-b4f7-c04cf0d216f1'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:43 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:43 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-73da10ae-35e0-4c10-bc27-3595f3a17ebc-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-73da10ae-35e0-4c10-bc27-3595f3a17ebc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-quobyte-b64507dd-3378-456c-a3b5-58b69c68c25a" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-b64507dd-3378-456c-a3b5-58b69c68c25a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-quobyte-73da10ae-35e0-4c10-bc27-3595f3a17ebc" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-73da10ae-35e0-4c10-bc27-3595f3a17ebc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Deleting offline snapshot 73da10ae-35e0-4c10-bc27-3595f3a17ebc of volume b64507dd-3378-456c-a3b5-58b69c68c25a {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] snapshot_file for this snap is: volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b218d490-c5fb-41cd-b8a2-c5070c6f974b]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:43 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.278s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Deleted volume successfully. Sep 21 16:44:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-721e1e09-645f-436b-ac13-b1ad8852daa8 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-2258d0a7-8281-4b70-a46c-1321711dc91c-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:43 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc Sep 21 16:44:43 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:44 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc" returned: 0 in 0.393s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b64507dd-3378-456c-a3b5-58b69c68c25a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b34d096-b93c-490c-b951-e9b22fd36f61]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:44 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a Sep 21 16:44:44 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Acquiring lock "cinder-860cac39-b826-4fdd-a778-2176e6bd0add-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Lock "cinder-860cac39-b826-4fdd-a778-2176e6bd0add-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Acquiring lock "cinder-quobyte-860cac39-b826-4fdd-a778-2176e6bd0add" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Lock "cinder-quobyte-860cac39-b826-4fdd-a778-2176e6bd0add" acquired by "delete_volume" :: waited 0.032s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d9ff11-f4ad-4930-b883-7431d6de1ac8]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-860cac39-b826-4fdd-a778-2176e6bd0add {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "cinder-243df5c7-80b6-4b1b-81e4-57916744ee5a-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:44 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Lock "cinder-243df5c7-80b6-4b1b-81e4-57916744ee5a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a" returned: 0 in 0.466s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:44 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc Sep 21 16:44:44 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "cinder-quobyte-243df5c7-80b6-4b1b-81e4-57916744ee5a" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Lock "cinder-quobyte-243df5c7-80b6-4b1b-81e4-57916744ee5a" acquired by "delete_volume" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:44 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-860cac39-b826-4fdd-a778-2176e6bd0add Sep 21 16:44:44 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[413401f5-d4e7-4bd7-86e0-d4d2276ec3f7]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-243df5c7-80b6-4b1b-81e4-57916744ee5a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:45 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-243df5c7-80b6-4b1b-81e4-57916744ee5a Sep 21 16:44:45 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:45 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-860cac39-b826-4fdd-a778-2176e6bd0add" returned: 0 in 0.499s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-860cac39-b826-4fdd-a778-2176e6bd0add {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:45 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-860cac39-b826-4fdd-a778-2176e6bd0add Sep 21 16:44:45 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:45 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc" returned: 0 in 0.497s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:45 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc Sep 21 16:44:45 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:45 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-243df5c7-80b6-4b1b-81e4-57916744ee5a" returned: 0 in 0.514s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-243df5c7-80b6-4b1b-81e4-57916744ee5a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:45 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-243df5c7-80b6-4b1b-81e4-57916744ee5a Sep 21 16:44:45 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:45 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-860cac39-b826-4fdd-a778-2176e6bd0add" returned: 0 in 0.305s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Lock "cinder-quobyte-860cac39-b826-4fdd-a778-2176e6bd0add" released by "delete_volume" :: held 0.873s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Created reservations ['f8d3be06-7466-4b61-9e9b-1c607bab0ff2', '62be787e-8eb7-40a6-ad58-91e7e52d129e', '685a58de-a47a-4f0b-9144-d4672922d155', 'ba5643dc-cd3a-4c14-91d9-ea16a02d3b11'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:45 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a.73da10ae-35e0-4c10-bc27-3595f3a17ebc" returned: 0 in 0.427s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:45 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-243df5c7-80b6-4b1b-81e4-57916744ee5a" returned: 0 in 0.327s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-73da10ae-35e0-4c10-bc27-3595f3a17ebc" released by "_delete_snapshot" :: held 1.951s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-b64507dd-3378-456c-a3b5-58b69c68c25a" released by "delete_snapshot" :: held 1.984s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Lock "cinder-quobyte-243df5c7-80b6-4b1b-81e4-57916744ee5a" released by "delete_volume" :: held 0.915s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:45 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:45 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Created reservations ['2dececb8-198b-46ea-b94c-eabf33aad46c', '9ce835ae-ee76-485b-bfdb-a65c2195a3e8', '381e00c2-fac3-496b-a70f-c98737efd172', '713a90fb-25e3-4696-a79b-da106f4175eb'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Created reservations ['804cc877-78a4-4145-ac07-c2f9197a3094', 'c77b8d1e-a4fa-4a3b-854e-8791835e42c3', '0c3831d2-e3e7-4eb3-a8dd-16f15eac9387', 'f331f579-09a6-4b60-9738-3927a0392639'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Delete snapshot completed successfully. Sep 21 16:44:46 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:46 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c938d679-e10d-4995-81e0-bf7012d84384 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-73da10ae-35e0-4c10-bc27-3595f3a17ebc-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:46 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.403s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:46 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Deleted volume successfully. Sep 21 16:44:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-89d14e57-bccf-4faa-b13d-e32cef4ecb1e tempest-VolumesListAdminTestJSON-784005182 None] Lock "cinder-860cac39-b826-4fdd-a778-2176e6bd0add-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:46 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.386s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:46 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Deleted volume successfully. Sep 21 16:44:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f5c64fe3-f874-4cd1-bf15-2c1fac30e320 tempest-VolumesListAdminTestJSON-307843753 None] Lock "cinder-243df5c7-80b6-4b1b-81e4-57916744ee5a-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-b64507dd-3378-456c-a3b5-58b69c68c25a-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-b64507dd-3378-456c-a3b5-58b69c68c25a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "cinder-quobyte-b64507dd-3378-456c-a3b5-58b69c68c25a" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-b64507dd-3378-456c-a3b5-58b69c68c25a" acquired by "delete_volume" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[37686847-6419-42cd-bf25-c79b4ac2e7b1]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "cinder-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Lock "cinder-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "cinder-quobyte-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Lock "cinder-quobyte-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff9a836-efaf-4b16-9294-1c1151297a95]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:47 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a Sep 21 16:44:47 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:47 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347 Sep 21 16:44:47 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:47 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a" returned: 0 in 0.554s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:47 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a Sep 21 16:44:47 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:47 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347" returned: 0 in 0.471s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:47 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347 Sep 21 16:44:47 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:48 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b64507dd-3378-456c-a3b5-58b69c68c25a" returned: 0 in 0.312s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-quobyte-b64507dd-3378-456c-a3b5-58b69c68c25a" released by "delete_volume" :: held 0.962s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Created reservations ['e80ab30a-7cbd-4349-8f23-6a572a0011ce', '57b0fc7d-b401-4c23-b349-34e957242032', 'da8d9e66-b19e-45fa-897a-e2934858f06b', '99b2ccbd-6d11-4b7a-9caf-6a39906da31d'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:48 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347" returned: 0 in 0.355s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Lock "cinder-quobyte-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347" released by "delete_volume" :: held 0.933s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Created reservations ['b75a3777-1417-48f2-b4d1-0e763fd63f5b', 'fb819e23-06eb-4a92-b93b-1020ca2408b4', '9531b22d-20d1-4924-a8ff-997df5afc8e4', 'e8b1f4c9-2543-42c2-9a2a-9870e174b6f8'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:48 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:48 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:48 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:48 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:48 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.302s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Deleted volume successfully. Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-455bcfe3-fbba-45e0-bd8a-762a2342f7e7 tempest-CreateVolumesFromSnapshotTest-654620845 None] Lock "cinder-b64507dd-3378-456c-a3b5-58b69c68c25a-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:48 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.328s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Deleted volume successfully. Sep 21 16:44:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-42627380-9986-4b7f-9fac-151fea386f2a tempest-VolumesListAdminTestJSON-307843753 None] Lock "cinder-a9ef4ff8-bfba-44d6-b22d-5d4b6800e347-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "cinder-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Lock "cinder-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "cinder-quobyte-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:44:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Lock "cinder-quobyte-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:44:49 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5edaff3-bcd8-452b-a580-bd8c060a9a21]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-4f2ffeba-bc35-4788-8770-b695cbb3d998 req-3ba007bb-edfc-431e-9275-95db8bd35a35 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-4f2ffeba-bc35-4788-8770-b695cbb3d998 req-3ba007bb-edfc-431e-9275-95db8bd35a35 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-4f2ffeba-bc35-4788-8770-b695cbb3d998 req-3ba007bb-edfc-431e-9275-95db8bd35a35 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:50 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b Sep 21 16:44:50 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-4f2ffeba-bc35-4788-8770-b695cbb3d998 req-3ba007bb-edfc-431e-9275-95db8bd35a35 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f655e8ea-6374-4bf0-abd3-ded11bb930a0', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:44:50 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-4f2ffeba-bc35-4788-8770-b695cbb3d998 req-3ba007bb-edfc-431e-9275-95db8bd35a35 tempest-TestServerVolumeAttachmentScenario-1993641867 None] attachment_update completed successfully. Sep 21 16:44:50 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b" returned: 0 in 0.487s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:50 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b Sep 21 16:44:50 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:50 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b" returned: 0 in 0.404s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Lock "cinder-quobyte-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b" released by "delete_volume" :: held 1.005s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:50 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Created reservations ['91d6748e-dc91-4099-a10d-820db07634d8', 'f11eb158-d622-4920-9ed6-92113bf5c4fa', '226fa5a8-ae3c-48fe-9926-22d8c0d196b1', '3dadf98b-af95-4dfe-bbbc-a7df69aff5b1'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:44:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:51 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:44:51 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:51 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.406s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:51 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:44:51 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Deleted volume successfully. Sep 21 16:44:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-38e68712-a8c3-4256-a762-fcebf62c88b1 tempest-VolumesListAdminTestJSON-307843753 None] Lock "cinder-5ffd85a6-3436-4f43-bf48-4d8364ea6a0b-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:44:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-47dec6a0-46d3-497b-bae0-038632e4abdd req-43bbbc7f-0c29-44a2-b836-b755bb24c3f3 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-47dec6a0-46d3-497b-bae0-038632e4abdd req-43bbbc7f-0c29-44a2-b836-b755bb24c3f3 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-47dec6a0-46d3-497b-bae0-038632e4abdd req-43bbbc7f-0c29-44a2-b836-b755bb24c3f3 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-47dec6a0-46d3-497b-bae0-038632e4abdd req-43bbbc7f-0c29-44a2-b836-b755bb24c3f3 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-ff3a56ad-375e-409c-b158-65770c70fbed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eaf66c7f-cae1-4a5f-a860-543d5945a1dd', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:44:56 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-47dec6a0-46d3-497b-bae0-038632e4abdd req-43bbbc7f-0c29-44a2-b836-b755bb24c3f3 tempest-TestServerVolumeAttachmentScenario-1993641867 None] attachment_update completed successfully. Sep 21 16:44:57 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Flow 'volume_create_manager' (0b65c019-bf6c-49a7-9df2-fd5c5eefd2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e11499-936a-455d-b974-50fe783dced6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e11499-936a-455d-b974-50fe783dced6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86dff93b-5ec9-4428-8b63-a3ff9fc64667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02de232dd3934122acb2a8ca30b68e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:58Z,use_quota=True,user_id='c478cc62d7884227a28becb2de598479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc87b6e-f19c-414c-b392-555cd4869ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc87b6e-f19c-414c-b392-555cd4869ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e6bfff-ef1f-4ede-a292-94b5ed48e9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:57 devstack cinder-volume[86030]: DEBUG cinder.image.glance [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Creating Keystone auth plugin from conf {{(pid=86030) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 16:44:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e6bfff-ef1f-4ede-a292-94b5ed48e9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86dff93b-5ec9-4428-8b63-a3ff9fc64667', 'volume_name': 'volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667', 'volume_size': 1, 'image_id': '55651b47-617c-4328-a1aa-42e4c57f2046', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55651b47-617c-4328-a1aa-42e4c57f2046', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f59e3c3f5a1a02c39103d89111d76531', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02de232dd3934122acb2a8ca30b68e7d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '225b2283e2f4c0ed8b84ced19bea684d42db716a28cc60ef8240b77aafe9c8acd4fc8c0b0f44e1c7d935baec127a7ec897bfdce0a18bb9466529b365b5bedb5c', 'id': '55651b47-617c-4328-a1aa-42e4c57f2046', 'created_at': datetime.datetime(2026, 9, 21, 14, 44, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 44, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55651b47-617c-4328-a1aa-42e4c57f2046/file', 'properties': {}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddc25e2-7abe-4841-815f-d7fa5f96db58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddc25e2-7abe-4841-815f-d7fa5f96db58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f666dbbe-6fc8-4149-a2e2-1d293df92947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:58 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Volume 86dff93b-5ec9-4428-8b63-a3ff9fc64667: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667', 'volume_size': 1, 'image_id': '55651b47-617c-4328-a1aa-42e4c57f2046', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55651b47-617c-4328-a1aa-42e4c57f2046', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f59e3c3f5a1a02c39103d89111d76531', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02de232dd3934122acb2a8ca30b68e7d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '225b2283e2f4c0ed8b84ced19bea684d42db716a28cc60ef8240b77aafe9c8acd4fc8c0b0f44e1c7d935baec127a7ec897bfdce0a18bb9466529b365b5bedb5c', 'id': '55651b47-617c-4328-a1aa-42e4c57f2046', 'created_at': datetime.datetime(2026, 9, 21, 14, 44, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 44, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55651b47-617c-4328-a1aa-42e4c57f2046/file', 'properties': {}}, 'image_service': } Sep 21 16:44:58 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Trying to clone 86dff93b-5ec9-4428-8b63-a3ff9fc64667 from image 55651b47-617c-4328-a1aa-42e4c57f2046 at location (None, [{'url': 'file:///opt/stack/data/glance/images/55651b47-617c-4328-a1aa-42e4c57f2046', 'metadata': {}}]). {{(pid=86030) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 16:44:58 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 16:44:58 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Image download 0.00 MB at 0.00 MB/s Sep 21 16:44:58 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[777f8dd2-a2b5-42ba-b776-47b91e2fb93e]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:58 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD Sep 21 16:44:58 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:58 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:59 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD Sep 21 16:44:59 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:59 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD" returned: 1 in 0.444s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Temporary image 55651b47-617c-4328-a1aa-42e4c57f2046 is fetched for user c478cc62d7884227a28becb2de598479. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8de705-e2a0-4df4-980f-e491c83c31c2]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Flow 'volume_create_manager' (091d7e99-876e-4003-a905-4d1acfe32805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fafe35-163c-4b76-b401-544c246cd1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fafe35-163c-4b76-b401-544c246cd1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-401372613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975523a1-671d-4c40-99cb-559f4608e404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b5897a02714b659e8888bb78efbbf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:00Z,use_quota=True,user_id='da15c749e78e48158c568452d6d6a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:59 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD Sep 21 16:44:59 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008022ff-e3fa-4602-8574-a46971f5604d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008022ff-e3fa-4602-8574-a46971f5604d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a5bad3-286d-4ad4-9d9f-614e51645ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a5bad3-286d-4ad4-9d9f-614e51645ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '975523a1-671d-4c40-99cb-559f4608e404', 'volume_name': 'volume-975523a1-671d-4c40-99cb-559f4608e404', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e2fd56-81d1-492d-8462-f02bdf1ed8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e2fd56-81d1-492d-8462-f02bdf1ed8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11f2ac8-cb43-41a1-b8ae-3bfe605c52f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:44:59 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Volume 975523a1-671d-4c40-99cb-559f4608e404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-975523a1-671d-4c40-99cb-559f4608e404', 'volume_size': 1} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-401372613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975523a1-671d-4c40-99cb-559f4608e404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b5897a02714b659e8888bb78efbbf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:00Z,use_quota=True,user_id='da15c749e78e48158c568452d6d6a058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Creating volume 975523a1-671d-4c40-99cb-559f4608e404 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:44:59 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:44:59 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-91e5c6b8-8f1e-4311-b595-6c3314205bd2 req-9007f5fb-3872-4178-9e7a-9cac6c423784 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Terminate volume connection completed successfully. Sep 21 16:44:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-91e5c6b8-8f1e-4311-b595-6c3314205bd2 req-9007f5fb-3872-4178-9e7a-9cac6c423784 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Deleting attachment eaf66c7f-cae1-4a5f-a860-543d5945a1dd. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:44:59 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404 1073741824 Sep 21 16:44:59 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:00 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:00 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD Sep 21 16:45:00 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:00 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404 1073741824" returned: 0 in 0.628s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:00 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD" returned: 1 in 0.495s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:00 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404 Sep 21 16:45:00 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:00 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404" returned: 0 in 0.339s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86dff93b-5ec9-4428-8b63-a3ff9fc64667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02de232dd3934122acb2a8ca30b68e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:44:58Z,use_quota=True,user_id='c478cc62d7884227a28becb2de598479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Creating volume 86dff93b-5ec9-4428-8b63-a3ff9fc64667 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:45:00 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11f2ac8-cb43-41a1-b8ae-3bfe605c52f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-975523a1-671d-4c40-99cb-559f4608e404', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb50a63-c7d3-443a-971c-f0ea523db947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:00 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 1073741824 Sep 21 16:45:00 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:00 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Volume volume-975523a1-671d-4c40-99cb-559f4608e404 (975523a1-671d-4c40-99cb-559f4608e404): created successfully Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb50a63-c7d3-443a-971c-f0ea523db947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Flow 'volume_create_manager' (091d7e99-876e-4003-a905-4d1acfe32805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:00 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4df06c9e-97f8-4939-bb31-acd1313caafe tempest-SnapshotMetadataTestJSON-1212931399 None] Created volume successfully. Sep 21 16:45:01 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-f97e1576-1190-4846-940f-41d2e83adbe1 req-7282e010-59fb-4647-b2c1-a12541b0cbb5 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Terminate volume connection completed successfully. Sep 21 16:45:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-f97e1576-1190-4846-940f-41d2e83adbe1 req-7282e010-59fb-4647-b2c1-a12541b0cbb5 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Deleting attachment f655e8ea-6374-4bf0-abd3-ded11bb930a0. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:45:01 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 1073741824" returned: 0 in 0.620s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:01 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 Sep 21 16:45:01 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:01 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667" returned: 0 in 0.315s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:01 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Attempting download of 55651b47-617c-4328-a1aa-42e4c57f2046 ((None, [{'url': 'file:///opt/stack/data/glance/images/55651b47-617c-4328-a1aa-42e4c57f2046', 'metadata': {}}])) to volume 86dff93b-5ec9-4428-8b63-a3ff9fc64667. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 21 16:45:01 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f7a4a6-109c-4010-abc0-1755353a1cd5]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55651b47-617c-4328-a1aa-42e4c57f2046_84ttr7hu {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] Creating offline snapshot 73b2b055-723d-497c-a193-e8236c835707 of volume 975523a1-671d-4c40-99cb-559f4608e404 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:45:02 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8450ab-8898-4eb7-9244-795532768628]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:02 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55651b47-617c-4328-a1aa-42e4c57f2046_84ttr7hu Sep 21 16:45:02 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:02 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404 Sep 21 16:45:02 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:02 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55651b47-617c-4328-a1aa-42e4c57f2046_84ttr7hu" returned: 0 in 0.505s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55651b47-617c-4328-a1aa-42e4c57f2046_84ttr7hu {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:02 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55651b47-617c-4328-a1aa-42e4c57f2046_84ttr7hu Sep 21 16:45:02 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:02 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404" returned: 0 in 0.597s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:02 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 1G Sep 21 16:45:02 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:02 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55651b47-617c-4328-a1aa-42e4c57f2046_84ttr7hu" returned: 1 in 0.465s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55651b47-617c-4328-a1aa-42e4c57f2046_84ttr7hu' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:45:02 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[0019204a-d267-4a51-b16b-044ece35bfd5]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:03 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD Sep 21 16:45:03 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:03 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 1G" returned: 0 in 0.842s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-975523a1-671d-4c40-99cb-559f4608e404 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:03 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-975523a1-671d-4c40-99cb-559f4608e404 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 Sep 21 16:45:03 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:03 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD" returned: 0 in 0.726s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:03 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD Sep 21 16:45:03 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:04 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-975523a1-671d-4c40-99cb-559f4608e404 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707" returned: 0 in 0.511s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:04 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 is being set with open permissions: ugo+rw Sep 21 16:45:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:04 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 Sep 21 16:45:04 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:04 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD" returned: 1 in 0.543s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:45:04 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] 55651b47-617c-4328-a1aa-42e4c57f2046 was raw, converting to qcow2 {{(pid=86030) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 16:45:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:04 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 Sep 21 16:45:04 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:04 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707" returned: 0 in 0.355s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:04 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.info Sep 21 16:45:04 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:04 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.info" returned: 0 in 0.379s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:04 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.info is being set with open permissions: ugo+rw Sep 21 16:45:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:04 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.info Sep 21 16:45:04 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:04 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667" returned: 0 in 0.748s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:04 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_55651b47-617c-4328-a1aa-42e4c57f2046_fjj0r0agdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:45:04 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Converted 0.00 MB image at 0.00 MB/s Sep 21 16:45:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:05 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 1G Sep 21 16:45:05 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:05 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.info" returned: 0 in 0.358s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.207s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Flow 'volume_create_manager' (7da757fa-2b6d-44a2-98c6-cb6c346174d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb412bc-47f0-473c-9ca6-889223194d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:05 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-cb111f43-2867-47cc-aff1-c3e2831aa111 tempest-SnapshotMetadataTestJSON-1212931399 None] Create snapshot completed successfully Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb412bc-47f0-473c-9ca6-889223194d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-412267402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec912df5-7db5-430e-a443-adac8748c076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aab19bba1ba14d16bafeb703e571e675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:05Z,use_quota=True,user_id='8fc3d17c94694b4b9dbbe56a60d3af8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00503c37-c625-4d4e-808e-c96021cb72e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00503c37-c625-4d4e-808e-c96021cb72e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9539f3f0-6155-436c-a5f7-700991e4b8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9539f3f0-6155-436c-a5f7-700991e4b8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec912df5-7db5-430e-a443-adac8748c076', 'volume_name': 'volume-ec912df5-7db5-430e-a443-adac8748c076', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146ee5c8-838b-44d6-b11f-dc7a1eb3529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146ee5c8-838b-44d6-b11f-dc7a1eb3529f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c87e89f-53ff-43bb-9ca1-86c30a473a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:05 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Volume ec912df5-7db5-430e-a443-adac8748c076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec912df5-7db5-430e-a443-adac8748c076', 'volume_size': 1} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-412267402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec912df5-7db5-430e-a443-adac8748c076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aab19bba1ba14d16bafeb703e571e675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:05Z,use_quota=True,user_id='8fc3d17c94694b4b9dbbe56a60d3af8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Creating volume ec912df5-7db5-430e-a443-adac8748c076 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:45:05 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:05 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 1073741824 Sep 21 16:45:05 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:05 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 1G" returned: 0 in 0.501s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Downloaded image 55651b47-617c-4328-a1aa-42e4c57f2046 ((None, [{'url': 'file:///opt/stack/data/glance/images/55651b47-617c-4328-a1aa-42e4c57f2046', 'metadata': {}}])) to volume 86dff93b-5ec9-4428-8b63-a3ff9fc64667 successfully. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Temporary image 55651b47-617c-4328-a1aa-42e4c57f2046 for user c478cc62d7884227a28becb2de598479 is deleted. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Marking volume 86dff93b-5ec9-4428-8b63-a3ff9fc64667 as bootable. {{(pid=86030) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Copying metadata from image 55651b47-617c-4328-a1aa-42e4c57f2046 to 86dff93b-5ec9-4428-8b63-a3ff9fc64667. {{(pid=86030) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Creating volume glance metadata for volume 86dff93b-5ec9-4428-8b63-a3ff9fc64667 backed by image 55651b47-617c-4328-a1aa-42e4c57f2046 with: {'image_id': '55651b47-617c-4328-a1aa-42e4c57f2046', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f59e3c3f5a1a02c39103d89111d76531', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86030) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f666dbbe-6fc8-4149-a2e2-1d293df92947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667', 'volume_size': 1, 'image_id': '55651b47-617c-4328-a1aa-42e4c57f2046', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55651b47-617c-4328-a1aa-42e4c57f2046', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f59e3c3f5a1a02c39103d89111d76531', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02de232dd3934122acb2a8ca30b68e7d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '225b2283e2f4c0ed8b84ced19bea684d42db716a28cc60ef8240b77aafe9c8acd4fc8c0b0f44e1c7d935baec127a7ec897bfdce0a18bb9466529b365b5bedb5c', 'id': '55651b47-617c-4328-a1aa-42e4c57f2046', 'created_at': datetime.datetime(2026, 9, 21, 14, 44, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 44, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55651b47-617c-4328-a1aa-42e4c57f2046/file', 'properties': {}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c8c525-f01c-4509-bb3b-34d6d5d3b1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:05 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Volume volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 (86dff93b-5ec9-4428-8b63-a3ff9fc64667): created successfully Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c8c525-f01c-4509-bb3b-34d6d5d3b1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Flow 'volume_create_manager' (0b65c019-bf6c-49a7-9df2-fd5c5eefd2a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:05 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fc27aaec-d746-43cf-a9b9-c97cd6f8e5b6 tempest-VolumeImageDependencyTests-1169369547 None] Created volume successfully. Sep 21 16:45:05 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 1073741824" returned: 0 in 0.505s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:05 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 Sep 21 16:45:05 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:06 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076" returned: 0 in 0.288s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c87e89f-53ff-43bb-9ca1-86c30a473a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec912df5-7db5-430e-a443-adac8748c076', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028e8f4a-ad30-4ff5-aedc-cf0a1a31f10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:06 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Volume volume-ec912df5-7db5-430e-a443-adac8748c076 (ec912df5-7db5-430e-a443-adac8748c076): created successfully Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028e8f4a-ad30-4ff5-aedc-cf0a1a31f10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Flow 'volume_create_manager' (7da757fa-2b6d-44a2-98c6-cb6c346174d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8b0c4862-c67d-4237-a8f6-b49864675ed4 tempest-VolumesActionsTest-424785027 None] Created volume successfully. Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Acquiring lock "cinder-86dff93b-5ec9-4428-8b63-a3ff9fc64667-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Lock "cinder-86dff93b-5ec9-4428-8b63-a3ff9fc64667-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Acquiring lock "cinder-quobyte-86dff93b-5ec9-4428-8b63-a3ff9fc64667" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Lock "cinder-quobyte-86dff93b-5ec9-4428-8b63-a3ff9fc64667" acquired by "delete_volume" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6eb873-41f9-4841-a985-4216b035e5e2]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:06 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 Sep 21 16:45:06 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Acquiring lock "cinder-ff3a56ad-375e-409c-b158-65770c70fbed-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "cinder-ff3a56ad-375e-409c-b158-65770c70fbed-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Acquiring lock "cinder-quobyte-ff3a56ad-375e-409c-b158-65770c70fbed" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "cinder-quobyte-ff3a56ad-375e-409c-b158-65770c70fbed" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[457c24eb-5913-41a9-a776-bed24dcd1ea2]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ff3a56ad-375e-409c-b158-65770c70fbed {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:06 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ff3a56ad-375e-409c-b158-65770c70fbed Sep 21 16:45:06 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:06 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667" returned: 0 in 0.417s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:07 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667 Sep 21 16:45:07 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Acquiring lock "cinder-73b2b055-723d-497c-a193-e8236c835707-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "cinder-73b2b055-723d-497c-a193-e8236c835707-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Acquiring lock "cinder-quobyte-975523a1-671d-4c40-99cb-559f4608e404" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "cinder-quobyte-975523a1-671d-4c40-99cb-559f4608e404" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Acquiring lock "cinder-quobyte-73b2b055-723d-497c-a193-e8236c835707" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:07 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "cinder-quobyte-73b2b055-723d-497c-a193-e8236c835707" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Deleting offline snapshot 73b2b055-723d-497c-a193-e8236c835707 of volume 975523a1-671d-4c40-99cb-559f4608e404 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:45:07 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] snapshot_file for this snap is: volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ff3a56ad-375e-409c-b158-65770c70fbed" returned: 0 in 0.502s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ff3a56ad-375e-409c-b158-65770c70fbed {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-86dff93b-5ec9-4428-8b63-a3ff9fc64667" returned: 0 in 0.361s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba40663-ddb9-4998-85c2-f376d298ac34]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:07 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ff3a56ad-375e-409c-b158-65770c70fbed Sep 21 16:45:07 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Lock "cinder-quobyte-86dff93b-5ec9-4428-8b63-a3ff9fc64667" released by "delete_volume" :: held 0.856s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Created reservations ['c312e8c9-fe9d-4b4e-9715-f420c3b82f26', '9e47cfa1-9931-4a98-b1de-6c32f90317f4', '9703ef72-2939-49a0-a52f-5781bdf573bc', '5794119b-b60e-4117-8682-7fe566daca25'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:07 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 Sep 21 16:45:07 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:07 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:07 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:07 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ff3a56ad-375e-409c-b158-65770c70fbed" returned: 0 in 0.363s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "cinder-quobyte-ff3a56ad-375e-409c-b158-65770c70fbed" released by "delete_volume" :: held 0.930s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Created reservations ['927c9f7e-8620-4e4b-97c1-e17ccdddf57b', 'ffaa1b1c-d0cf-4417-8efe-2f7b5a5600ac', '4f932f77-8c90-4912-8d89-ee5cc6f48be3', 'eff7ed90-cda3-4ba9-8cc4-2d325f08b4a6'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:07 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:07 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:07 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707" returned: 0 in 0.557s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-975523a1-671d-4c40-99cb-559f4608e404(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50d0ac2-3cf0-4c5c-99d1-bd16850efa0e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:08 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:08 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:08 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.500s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:08 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Deleted volume successfully. Sep 21 16:45:08 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404 Sep 21 16:45:08 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0107ab97-eab1-47b7-999f-04ea24682896 tempest-VolumeImageDependencyTests-1169369547 None] Lock "cinder-86dff93b-5ec9-4428-8b63-a3ff9fc64667-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:08 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.339s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 28 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:45:08 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.428s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:08 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Deleted volume successfully. Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-47f6b213-0d0c-4198-873b-62fc70e2722a tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "cinder-ff3a56ad-375e-409c-b158-65770c70fbed-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:08 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404" returned: 0 in 0.532s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:08 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 Sep 21 16:45:08 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:08 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707" returned: 0 in 0.432s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:09 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707 Sep 21 16:45:09 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Acquiring lock "cinder-62b9c1d6-6855-47b6-84db-e8e0e47ace76-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "cinder-62b9c1d6-6855-47b6-84db-e8e0e47ace76-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Acquiring lock "cinder-quobyte-62b9c1d6-6855-47b6-84db-e8e0e47ace76" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "cinder-quobyte-62b9c1d6-6855-47b6-84db-e8e0e47ace76" acquired by "delete_volume" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:09 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[624914af-8a3b-4c0e-8f59-8a1dce493596]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:09 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404.73b2b055-723d-497c-a193-e8236c835707" returned: 0 in 0.430s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:09 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76 Sep 21 16:45:09 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "cinder-quobyte-73b2b055-723d-497c-a193-e8236c835707" released by "_delete_snapshot" :: held 2.174s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "cinder-quobyte-975523a1-671d-4c40-99cb-559f4608e404" released by "delete_snapshot" :: held 2.214s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:09 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Created reservations ['e190e698-fd3c-4f2d-b9d3-35827c263edb', 'f216f549-d29c-4e20-a1cd-aa1c62649c29', '2558b0d3-bc29-4c1c-ba77-271dbe93c716', '925e4b2b-a56e-425a-ae79-e8765a07b995'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:09 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Delete snapshot completed successfully. Sep 21 16:45:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e9f8015-f0fc-4d19-97ca-b6ebbb6915a3 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "cinder-73b2b055-723d-497c-a193-e8236c835707-delete_snapshot" released by "delete_snapshot" :: held 2.417s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:09 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76" returned: 0 in 0.546s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:09 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76 Sep 21 16:45:09 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:10 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-62b9c1d6-6855-47b6-84db-e8e0e47ace76" returned: 0 in 0.305s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "cinder-quobyte-62b9c1d6-6855-47b6-84db-e8e0e47ace76" released by "delete_volume" :: held 0.913s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Created reservations ['f45db878-89bd-4b64-ab13-0cb93c49ac6c', 'ed364091-d08c-4266-a04c-aabe683db2ff', '4bdfe7fa-c91b-4011-b9f5-bec08bf8e291', 'bcf921de-ce6e-4dd7-a1e1-e9f922410033'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:10 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:10 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Acquiring lock "cinder-975523a1-671d-4c40-99cb-559f4608e404-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "cinder-975523a1-671d-4c40-99cb-559f4608e404-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:10 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.415s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:10 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Deleted volume successfully. Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Acquiring lock "cinder-quobyte-975523a1-671d-4c40-99cb-559f4608e404" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5d916fea-1ebf-4c1a-8d84-45ae8a9825d2 tempest-TestServerVolumeAttachmentScenario-1993641867 None] Lock "cinder-62b9c1d6-6855-47b6-84db-e8e0e47ace76-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "cinder-quobyte-975523a1-671d-4c40-99cb-559f4608e404" acquired by "delete_volume" :: waited 0.039s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[248c71f2-d113-41b6-b680-f99b62555050]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:11 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404 Sep 21 16:45:11 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:11 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404" returned: 0 in 0.561s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:11 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404 Sep 21 16:45:11 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:11 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-975523a1-671d-4c40-99cb-559f4608e404" returned: 0 in 0.451s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "cinder-quobyte-975523a1-671d-4c40-99cb-559f4608e404" released by "delete_volume" :: held 1.134s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:12 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Created reservations ['ed04936c-c149-4c9f-afde-6d288358c473', '8ef989f0-fe11-4930-bdf6-c84fd00cc0fe', '33ac5fe8-3391-4015-9010-2ddeef861b99', '85c4ac87-9733-44d9-a62d-c170e4c17e7f'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:12 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:12 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:12 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.319s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:12 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:12 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Deleted volume successfully. Sep 21 16:45:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf5f5388-ed3d-4a4f-b58b-723097fb74e4 tempest-SnapshotMetadataTestJSON-1212931399 None] Lock "cinder-975523a1-671d-4c40-99cb-559f4608e404-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Flow 'volume_create_manager' (dbe0fa57-b4fe-4f3a-bde7-fbc713619a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2589f4-b2f5-4df0-8d5c-3b7ef33c0efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2589f4-b2f5-4df0-8d5c-3b7ef33c0efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1719222848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25217f29d23c49f6aa44ec0ee63e63f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:13Z,use_quota=True,user_id='ae1430279771456495e34caf72340fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d60c4e-8f67-4e38-abd7-2f8baea0fcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d60c4e-8f67-4e38-abd7-2f8baea0fcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be04f5e-6dab-4778-b00d-dcc7d9876388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be04f5e-6dab-4778-b00d-dcc7d9876388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4', 'volume_name': 'volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd9331d-b4ac-4084-811e-34d71a2316af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd9331d-b4ac-4084-811e-34d71a2316af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa1b483-0e28-489c-a937-1d9d11116a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:13 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Volume e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4', 'volume_size': 1} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1719222848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25217f29d23c49f6aa44ec0ee63e63f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:13Z,use_quota=True,user_id='ae1430279771456495e34caf72340fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Creating volume e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:45:13 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:45:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:13 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4 1073741824 Sep 21 16:45:13 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:14 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4 1073741824" returned: 0 in 0.922s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:14 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4 Sep 21 16:45:14 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:15 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4" returned: 0 in 0.617s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa1b483-0e28-489c-a937-1d9d11116a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a861025c-c859-44bc-971a-c0164b1caace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:15 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Volume volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4 (e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4): created successfully Sep 21 16:45:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a861025c-c859-44bc-971a-c0164b1caace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Flow 'volume_create_manager' (dbe0fa57-b4fe-4f3a-bde7-fbc713619a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:15 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4089ad96-5d85-4c41-975d-97e1167b6557 tempest-ProjectReaderTests-1194987291 None] Created volume successfully. Sep 21 16:45:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "cinder-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:16 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "cinder-quobyte-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:16 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-quobyte-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4" acquired by "delete_volume" :: waited 0.059s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:16 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fea5df8-0809-4ea1-b736-be3e41f9fcac]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:16 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4 Sep 21 16:45:16 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:16 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4" returned: 0 in 0.567s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:16 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4 Sep 21 16:45:16 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:17 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4" returned: 0 in 0.480s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-quobyte-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4" released by "delete_volume" :: held 1.151s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:17 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Created reservations ['adc1d86c-cf87-4714-bbf6-89a3e271f4a2', 'eec1baea-aca1-45a7-8990-8454ace86336', 'bb9766a0-59ef-4ece-bcec-edb8f015539b', '852eec55-92e6-4ea8-88e1-0c8f5d472961'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:17 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:17 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43dc7ab8-623f-4e19-84a7-24292bef36bc tempest-VolumesActionsTest-424785027 None] Acquiring lock "cinder-ec912df5-7db5-430e-a443-adac8748c076" by "attach_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43dc7ab8-623f-4e19-84a7-24292bef36bc tempest-VolumesActionsTest-424785027 None] Lock "cinder-ec912df5-7db5-430e-a443-adac8748c076" acquired by "attach_volume" :: waited 0.043s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:17 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-43dc7ab8-623f-4e19-84a7-24292bef36bc tempest-VolumesActionsTest-424785027 None] Attaching volume ec912df5-7db5-430e-a443-adac8748c076 to instance a86dd188-d616-49e9-b3e6-caf074c62319 at mountpoint /dev/vdb on host None. Sep 21 16:45:17 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-43dc7ab8-623f-4e19-84a7-24292bef36bc tempest-VolumesActionsTest-424785027 None] Attach volume completed successfully. Sep 21 16:45:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43dc7ab8-623f-4e19-84a7-24292bef36bc tempest-VolumesActionsTest-424785027 None] Lock "cinder-ec912df5-7db5-430e-a443-adac8748c076" released by "attach_volume" :: held 0.205s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:18 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.578s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:18 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:18 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Deleted volume successfully. Sep 21 16:45:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-485c7765-710a-4164-9764-5df6e2af4049 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-e6fcec94-bb8e-4ab1-a9ef-d1f919582fa4-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-09396333-9581-4c2c-ae27-f72e0d9d7a69 tempest-VolumesActionsTest-424785027 None] Acquiring lock "cinder-ec912df5-7db5-430e-a443-adac8748c076-detach_volume" by "detach_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-09396333-9581-4c2c-ae27-f72e0d9d7a69 tempest-VolumesActionsTest-424785027 None] Lock "cinder-ec912df5-7db5-430e-a443-adac8748c076-detach_volume" acquired by "detach_volume" :: waited 0.065s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:18 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-09396333-9581-4c2c-ae27-f72e0d9d7a69 tempest-VolumesActionsTest-424785027 None] Detaching volume ec912df5-7db5-430e-a443-adac8748c076 from instance a86dd188-d616-49e9-b3e6-caf074c62319. Sep 21 16:45:18 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-09396333-9581-4c2c-ae27-f72e0d9d7a69 tempest-VolumesActionsTest-424785027 None] Detach volume completed successfully. Sep 21 16:45:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-09396333-9581-4c2c-ae27-f72e0d9d7a69 tempest-VolumesActionsTest-424785027 None] Lock "cinder-ec912df5-7db5-430e-a443-adac8748c076-detach_volume" released by "detach_volume" :: held 0.213s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Flow 'volume_create_manager' (7cad545f-56a5-40ff-aa39-4c6c9110e1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203ac043-2624-4e29-ae3c-7c2e5ce458cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203ac043-2624-4e29-ae3c-7c2e5ce458cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443374992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57b6b4b-927a-4394-8704-eabaec91c2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25217f29d23c49f6aa44ec0ee63e63f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:19Z,use_quota=True,user_id='ae1430279771456495e34caf72340fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d295f8-b1dd-487c-9a68-d90b675d35d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d295f8-b1dd-487c-9a68-d90b675d35d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80b58cf-a16c-469a-9c18-1a60e88011f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80b58cf-a16c-469a-9c18-1a60e88011f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e57b6b4b-927a-4394-8704-eabaec91c2ca', 'volume_name': 'volume-e57b6b4b-927a-4394-8704-eabaec91c2ca', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8cc61d-4ee5-46e9-8c68-e3e75324fd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8cc61d-4ee5-46e9-8c68-e3e75324fd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add23a6b-5264-4df4-9b65-ebac6111dd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:19 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Volume e57b6b4b-927a-4394-8704-eabaec91c2ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e57b6b4b-927a-4394-8704-eabaec91c2ca', 'volume_size': 1} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443374992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57b6b4b-927a-4394-8704-eabaec91c2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25217f29d23c49f6aa44ec0ee63e63f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:19Z,use_quota=True,user_id='ae1430279771456495e34caf72340fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Creating volume e57b6b4b-927a-4394-8704-eabaec91c2ca {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:45:19 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e57b6b4b-927a-4394-8704-eabaec91c2ca 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:19 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e57b6b4b-927a-4394-8704-eabaec91c2ca 1073741824 Sep 21 16:45:19 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:19 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e57b6b4b-927a-4394-8704-eabaec91c2ca 1073741824" returned: 0 in 0.677s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e57b6b4b-927a-4394-8704-eabaec91c2ca {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:20 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e57b6b4b-927a-4394-8704-eabaec91c2ca Sep 21 16:45:20 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:20 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e57b6b4b-927a-4394-8704-eabaec91c2ca" returned: 0 in 0.409s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add23a6b-5264-4df4-9b65-ebac6111dd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57b6b4b-927a-4394-8704-eabaec91c2ca', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930e24bf-239d-4e09-8cf4-e5956823ca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:20 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Volume volume-e57b6b4b-927a-4394-8704-eabaec91c2ca (e57b6b4b-927a-4394-8704-eabaec91c2ca): created successfully Sep 21 16:45:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930e24bf-239d-4e09-8cf4-e5956823ca35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Flow 'volume_create_manager' (7cad545f-56a5-40ff-aa39-4c6c9110e1ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:20 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6cf5ea5c-d3da-4265-8e62-e55b9dc48804 tempest-ProjectReaderTests-1194987291 None] Created volume successfully. Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "cinder-e57b6b4b-927a-4394-8704-eabaec91c2ca-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-e57b6b4b-927a-4394-8704-eabaec91c2ca-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Flow 'volume_create_manager' (b9a145ca-5f33-4570-9458-cc6c8c33ea82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb20166-cb9d-4321-873d-1be1d15e5c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "cinder-quobyte-e57b6b4b-927a-4394-8704-eabaec91c2ca" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb20166-cb9d-4321-873d-1be1d15e5c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1940918004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2f0115-5e26-4bd4-b6a8-46a8cefe6100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95934c5533cf4699be5a59d0ba76ae0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:21Z,use_quota=True,user_id='db7cc6b3eeae471b8767b440f17483de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf6b511-0725-415a-9a3b-681b5ca7ad24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf6b511-0725-415a-9a3b-681b5ca7ad24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4b67b5-86db-4409-b716-9eb541fe46ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4b67b5-86db-4409-b716-9eb541fe46ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb2f0115-5e26-4bd4-b6a8-46a8cefe6100', 'volume_name': 'volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0771ec0-262d-4994-aa4b-cb1061ab22ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0771ec0-262d-4994-aa4b-cb1061ab22ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e8464e-f99c-4818-94b4-89feb7854a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:21 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Volume cb2f0115-5e26-4bd4-b6a8-46a8cefe6100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100', 'volume_size': 1} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1940918004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2f0115-5e26-4bd4-b6a8-46a8cefe6100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95934c5533cf4699be5a59d0ba76ae0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:21Z,use_quota=True,user_id='db7cc6b3eeae471b8767b440f17483de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Creating volume cb2f0115-5e26-4bd4-b6a8-46a8cefe6100 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:45:21 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-quobyte-e57b6b4b-927a-4394-8704-eabaec91c2ca" acquired by "delete_volume" :: waited 0.087s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:21 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100 1073741824 Sep 21 16:45:21 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92be381-e532-4ba6-9dc2-b0cb99976da8]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e57b6b4b-927a-4394-8704-eabaec91c2ca {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:21 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e57b6b4b-927a-4394-8704-eabaec91c2ca Sep 21 16:45:21 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:22 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e57b6b4b-927a-4394-8704-eabaec91c2ca" returned: 0 in 0.406s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e57b6b4b-927a-4394-8704-eabaec91c2ca {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:22 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e57b6b4b-927a-4394-8704-eabaec91c2ca Sep 21 16:45:22 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:22 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100 1073741824" returned: 0 in 0.586s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:22 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100 Sep 21 16:45:22 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:22 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e57b6b4b-927a-4394-8704-eabaec91c2ca" returned: 0 in 0.345s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-quobyte-e57b6b4b-927a-4394-8704-eabaec91c2ca" released by "delete_volume" :: held 0.820s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Created reservations ['50f63f49-a06f-4a13-8579-3e148999560f', '69d39ced-02b8-4a0c-93d2-bcbd018430d6', '12f5bb79-1cdd-49f2-b323-218cd0fb857a', '2690e563-6c0e-4f3c-90c4-4865b0dcd170'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:22 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100" returned: 0 in 0.310s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e8464e-f99c-4818-94b4-89feb7854a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a526a26-3726-4839-907b-d98322b8fc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:22 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Volume volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100 (cb2f0115-5e26-4bd4-b6a8-46a8cefe6100): created successfully Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a526a26-3726-4839-907b-d98322b8fc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Flow 'volume_create_manager' (b9a145ca-5f33-4570-9458-cc6c8c33ea82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:22 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b110c2d9-b83d-46fe-af66-7cafb3140993 tempest-AbsoluteLimitsTests-1372839123 None] Created volume successfully. Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:22 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:22 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:23 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.257s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:23 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:23 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Deleted volume successfully. Sep 21 16:45:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-bde23b66-849b-43a5-8a2d-4e757bd75c55 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-e57b6b4b-927a-4394-8704-eabaec91c2ca-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Acquiring lock "cinder-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Lock "cinder-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Acquiring lock "cinder-quobyte-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Lock "cinder-quobyte-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100" acquired by "delete_volume" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f01a5a1-2084-45d0-aaab-de5b783ecd50]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:24 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100 Sep 21 16:45:24 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:24 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Flow 'volume_create_manager' (fb6f44c3-7239-48be-9a73-b4b7bbf7673f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba5a2f6-cf64-4b96-a5a5-a5116249b97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100" returned: 0 in 0.585s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba5a2f6-cf64-4b96-a5a5-a5116249b97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-353198189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a0b1033-2769-4be8-aa3d-572d87f040e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25217f29d23c49f6aa44ec0ee63e63f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:25Z,use_quota=True,user_id='ae1430279771456495e34caf72340fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87595999-40ad-4894-8d15-18adb48fc4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:24 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100 Sep 21 16:45:24 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87595999-40ad-4894-8d15-18adb48fc4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ed3133-3787-4677-a09f-ee7accb2cb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ed3133-3787-4677-a09f-ee7accb2cb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a0b1033-2769-4be8-aa3d-572d87f040e1', 'volume_name': 'volume-9a0b1033-2769-4be8-aa3d-572d87f040e1', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e0f62c-4be3-4b9b-954a-b31f98d913ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e0f62c-4be3-4b9b-954a-b31f98d913ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2f1ac7-a717-46c4-b617-0d63a5aca54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:24 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Volume 9a0b1033-2769-4be8-aa3d-572d87f040e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a0b1033-2769-4be8-aa3d-572d87f040e1', 'volume_size': 1} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-353198189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a0b1033-2769-4be8-aa3d-572d87f040e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25217f29d23c49f6aa44ec0ee63e63f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:25Z,use_quota=True,user_id='ae1430279771456495e34caf72340fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Creating volume 9a0b1033-2769-4be8-aa3d-572d87f040e1 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:45:24 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:45:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a0b1033-2769-4be8-aa3d-572d87f040e1 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:24 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a0b1033-2769-4be8-aa3d-572d87f040e1 1073741824 Sep 21 16:45:24 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:25 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100" returned: 0 in 0.485s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Lock "cinder-quobyte-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100" released by "delete_volume" :: held 1.143s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Created reservations ['d37b10b0-5080-4255-a1de-c97609f58fff', '1af842c1-fdf4-4393-9d05-2e9696bce49f', 'e8d36db8-d64d-4600-b171-66eb64fc78c7', 'cb8f9529-3268-4f1a-b428-42875148b24d'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:25 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:25 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:25 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a0b1033-2769-4be8-aa3d-572d87f040e1 1073741824" returned: 0 in 0.832s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a0b1033-2769-4be8-aa3d-572d87f040e1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:25 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a0b1033-2769-4be8-aa3d-572d87f040e1 Sep 21 16:45:25 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:25 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.496s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:25 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Deleted volume successfully. Sep 21 16:45:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-21f7fe2a-0243-451e-bafa-587d4000fec3 tempest-AbsoluteLimitsTests-1372839123 None] Lock "cinder-cb2f0115-5e26-4bd4-b6a8-46a8cefe6100-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:26 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a0b1033-2769-4be8-aa3d-572d87f040e1" returned: 0 in 0.332s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2f1ac7-a717-46c4-b617-0d63a5aca54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a0b1033-2769-4be8-aa3d-572d87f040e1', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817e6e89-35c8-4e9d-babb-16e98c0d9942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:26 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Volume volume-9a0b1033-2769-4be8-aa3d-572d87f040e1 (9a0b1033-2769-4be8-aa3d-572d87f040e1): created successfully Sep 21 16:45:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817e6e89-35c8-4e9d-babb-16e98c0d9942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Flow 'volume_create_manager' (fb6f44c3-7239-48be-9a73-b4b7bbf7673f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d9a5991d-e2ed-4190-8eb7-dbf2f891b564 tempest-ProjectReaderTests-1194987291 None] Created volume successfully. Sep 21 16:45:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "cinder-9a0b1033-2769-4be8-aa3d-572d87f040e1-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-9a0b1033-2769-4be8-aa3d-572d87f040e1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "cinder-quobyte-9a0b1033-2769-4be8-aa3d-572d87f040e1" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-quobyte-9a0b1033-2769-4be8-aa3d-572d87f040e1" acquired by "delete_volume" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:27 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2350df-8517-448e-9e13-d31879995b62]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a0b1033-2769-4be8-aa3d-572d87f040e1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:27 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a0b1033-2769-4be8-aa3d-572d87f040e1 Sep 21 16:45:27 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:27 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a0b1033-2769-4be8-aa3d-572d87f040e1" returned: 0 in 0.610s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a0b1033-2769-4be8-aa3d-572d87f040e1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:27 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a0b1033-2769-4be8-aa3d-572d87f040e1 Sep 21 16:45:27 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:27 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9a0b1033-2769-4be8-aa3d-572d87f040e1" returned: 0 in 0.299s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-quobyte-9a0b1033-2769-4be8-aa3d-572d87f040e1" released by "delete_volume" :: held 0.985s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:28 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Created reservations ['93f4f2aa-784f-46fc-9878-3e5073898f41', '1b9174fa-505e-4a5d-8fe2-d126fa527972', 'a5e32caf-4548-42fe-9025-f96be6561bf4', 'fddb68de-328d-452d-a8a5-b3f921eb6535'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:28 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:28 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:28 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:28 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:28 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.405s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:28 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:28 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Deleted volume successfully. Sep 21 16:45:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7de44dd0-a77d-4d3f-8d4e-c24943c68bb5 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-9a0b1033-2769-4be8-aa3d-572d87f040e1-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Flow 'volume_create_manager' (059dd277-2734-4712-988d-3714a6799dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908ace40-cbf6-4c01-b683-8442e14a2bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908ace40-cbf6-4c01-b683-8442e14a2bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2087975648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42439b8f-8fee-4577-bd31-78026dbda382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25217f29d23c49f6aa44ec0ee63e63f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:30Z,use_quota=True,user_id='ae1430279771456495e34caf72340fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8f9015-5632-406c-95ed-763a2527bb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8f9015-5632-406c-95ed-763a2527bb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715b9385-0954-437e-8708-4cdc2f7b4dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715b9385-0954-437e-8708-4cdc2f7b4dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42439b8f-8fee-4577-bd31-78026dbda382', 'volume_name': 'volume-42439b8f-8fee-4577-bd31-78026dbda382', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b7a153-230a-4342-aeb9-ee7e8ae06158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b7a153-230a-4342-aeb9-ee7e8ae06158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abda6f18-35e4-44bb-9f91-c255e2e9882c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:30 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Volume 42439b8f-8fee-4577-bd31-78026dbda382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42439b8f-8fee-4577-bd31-78026dbda382', 'volume_size': 1} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2087975648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42439b8f-8fee-4577-bd31-78026dbda382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25217f29d23c49f6aa44ec0ee63e63f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:30Z,use_quota=True,user_id='ae1430279771456495e34caf72340fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Creating volume 42439b8f-8fee-4577-bd31-78026dbda382 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:45:30 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:45:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42439b8f-8fee-4577-bd31-78026dbda382 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:30 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42439b8f-8fee-4577-bd31-78026dbda382 1073741824 Sep 21 16:45:30 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=153,cinder:UPDATE=201,cinder:INSERT=56,cinder:DELETE=19 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Flow 'volume_create_manager' (4e0c06f3-a153-4674-b14b-f9a47627701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260292ec-8838-4667-9fa9-9e2e1cf58291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260292ec-8838-4667-9fa9-9e2e1cf58291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123448774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b912eb-9440-4963-a813-c2379fc7e395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c43c479097438e9c178226383ac3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:31Z,use_quota=True,user_id='d0fdd4a11fc34c5f9aeb6169edb99c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:31 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac2035a-ae69-4f4d-955d-86af80d9b37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac2035a-ae69-4f4d-955d-86af80d9b37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f97ff1b-62db-419f-ab38-8576a52f69b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f97ff1b-62db-419f-ab38-8576a52f69b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b912eb-9440-4963-a813-c2379fc7e395', 'volume_name': 'volume-f2b912eb-9440-4963-a813-c2379fc7e395', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423b682b-7cfb-49df-a125-6f6fc22d9a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423b682b-7cfb-49df-a125-6f6fc22d9a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa7a9f6-e478-449f-898c-f469cefe863c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:31 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Volume f2b912eb-9440-4963-a813-c2379fc7e395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b912eb-9440-4963-a813-c2379fc7e395', 'volume_size': 1} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42439b8f-8fee-4577-bd31-78026dbda382 1073741824" returned: 0 in 1.268s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=218,cinder:SELECT=171,cinder:DELETE=15,cinder:INSERT=51 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:45:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42439b8f-8fee-4577-bd31-78026dbda382 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:32 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42439b8f-8fee-4577-bd31-78026dbda382 Sep 21 16:45:32 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:32 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Flow 'volume_create_manager' (03ccfb79-d44e-499d-aee6-7891e4c0a69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1ec143-287a-4293-bb29-5b114c95d67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42439b8f-8fee-4577-bd31-78026dbda382" returned: 0 in 0.692s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.770s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123448774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b912eb-9440-4963-a813-c2379fc7e395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c43c479097438e9c178226383ac3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:31Z,use_quota=True,user_id='d0fdd4a11fc34c5f9aeb6169edb99c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Creating volume f2b912eb-9440-4963-a813-c2379fc7e395 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:45:32 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f2b912eb-9440-4963-a813-c2379fc7e395 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1ec143-287a-4293-bb29-5b114c95d67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1729318433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc26ac32-1810-44e0-80b9-ad1f87e7d756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c43c479097438e9c178226383ac3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:32Z,use_quota=True,user_id='d0fdd4a11fc34c5f9aeb6169edb99c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f1716f-7e07-41e4-9062-e521e492c348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f1716f-7e07-41e4-9062-e521e492c348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f71fa7-8287-45a6-8e7b-e8068645ad81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f71fa7-8287-45a6-8e7b-e8068645ad81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc26ac32-1810-44e0-80b9-ad1f87e7d756', 'volume_name': 'volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f65345-3139-4235-9865-5a4e85191984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:32 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f2b912eb-9440-4963-a813-c2379fc7e395 1073741824 Sep 21 16:45:32 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f65345-3139-4235-9865-5a4e85191984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1c575b-e171-4cdf-b297-e53b5d193d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:32 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Volume dc26ac32-1810-44e0-80b9-ad1f87e7d756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756', 'volume_size': 1} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6693db80-5a69-4445-94fb-dbe4ad2dc502 tempest-VolumesActionsTest-424785027 None] Acquiring lock "cinder-ec912df5-7db5-430e-a443-adac8748c076" by "attach_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abda6f18-35e4-44bb-9f91-c255e2e9882c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42439b8f-8fee-4577-bd31-78026dbda382', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e74a71-b0a8-4f45-87dd-8bd594ae7923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6693db80-5a69-4445-94fb-dbe4ad2dc502 tempest-VolumesActionsTest-424785027 None] Lock "cinder-ec912df5-7db5-430e-a443-adac8748c076" acquired by "attach_volume" :: waited 0.112s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:32 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Volume volume-42439b8f-8fee-4577-bd31-78026dbda382 (42439b8f-8fee-4577-bd31-78026dbda382): created successfully Sep 21 16:45:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e74a71-b0a8-4f45-87dd-8bd594ae7923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Flow 'volume_create_manager' (059dd277-2734-4712-988d-3714a6799dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8e753115-6010-42ab-bc40-5745e19de4c0 tempest-ProjectReaderTests-1194987291 None] Created volume successfully. Sep 21 16:45:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6693db80-5a69-4445-94fb-dbe4ad2dc502 tempest-VolumesActionsTest-424785027 None] Attaching volume ec912df5-7db5-430e-a443-adac8748c076 to instance 6fee0dd2-e179-4de9-8380-e88eb3f41986 at mountpoint /dev/vdb on host None. Sep 21 16:45:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6693db80-5a69-4445-94fb-dbe4ad2dc502 tempest-VolumesActionsTest-424785027 None] Attach volume completed successfully. Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6693db80-5a69-4445-94fb-dbe4ad2dc502 tempest-VolumesActionsTest-424785027 None] Lock "cinder-ec912df5-7db5-430e-a443-adac8748c076" released by "attach_volume" :: held 0.212s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Flow 'volume_create_manager' (10dd0115-1207-4ebc-aec1-8be1101b51e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17058c7-d5be-44e5-85cc-cb90810dfbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17058c7-d5be-44e5-85cc-cb90810dfbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1173725480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa23530a-62b3-420c-b2f1-692e75dfb325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c43c479097438e9c178226383ac3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:33Z,use_quota=True,user_id='d0fdd4a11fc34c5f9aeb6169edb99c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d8eb1e-120d-43ba-84f5-65db60b48fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:33 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d8eb1e-120d-43ba-84f5-65db60b48fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14453249-7eea-4d70-ad69-88dfab6965d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14453249-7eea-4d70-ad69-88dfab6965d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa23530a-62b3-420c-b2f1-692e75dfb325', 'volume_name': 'volume-aa23530a-62b3-420c-b2f1-692e75dfb325', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3edd46a-fb58-41b5-8eb4-e61082f3c6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3edd46a-fb58-41b5-8eb4-e61082f3c6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7645f283-8a8f-40b4-b357-3a137eb22630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:33 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Volume aa23530a-62b3-420c-b2f1-692e75dfb325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa23530a-62b3-420c-b2f1-692e75dfb325', 'volume_size': 1} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f2b912eb-9440-4963-a813-c2379fc7e395 1073741824" returned: 0 in 0.920s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f2b912eb-9440-4963-a813-c2379fc7e395 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:33 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f2b912eb-9440-4963-a813-c2379fc7e395 Sep 21 16:45:33 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:34 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f2b912eb-9440-4963-a813-c2379fc7e395" returned: 0 in 0.443s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.302s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1729318433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc26ac32-1810-44e0-80b9-ad1f87e7d756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c43c479097438e9c178226383ac3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:32Z,use_quota=True,user_id='d0fdd4a11fc34c5f9aeb6169edb99c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Creating volume dc26ac32-1810-44e0-80b9-ad1f87e7d756 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:45:34 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:34 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756 1073741824 Sep 21 16:45:34 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8e602330-be7d-4b16-89e2-4c2936232e5a tempest-VolumesActionsTest-424785027 None] Acquiring lock "cinder-ec912df5-7db5-430e-a443-adac8748c076-detach_volume" by "detach_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa7a9f6-e478-449f-898c-f469cefe863c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b912eb-9440-4963-a813-c2379fc7e395', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d7daff-ce95-48a8-96ae-454a0b17a290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8e602330-be7d-4b16-89e2-4c2936232e5a tempest-VolumesActionsTest-424785027 None] Lock "cinder-ec912df5-7db5-430e-a443-adac8748c076-detach_volume" acquired by "detach_volume" :: waited 0.105s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:34 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8e602330-be7d-4b16-89e2-4c2936232e5a tempest-VolumesActionsTest-424785027 None] Detaching volume ec912df5-7db5-430e-a443-adac8748c076 from instance 6fee0dd2-e179-4de9-8380-e88eb3f41986. Sep 21 16:45:34 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Volume volume-f2b912eb-9440-4963-a813-c2379fc7e395 (f2b912eb-9440-4963-a813-c2379fc7e395): created successfully Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d7daff-ce95-48a8-96ae-454a0b17a290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Flow 'volume_create_manager' (4e0c06f3-a153-4674-b14b-f9a47627701e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Flow 'volume_create_manager' (7a4bac73-4b41-4425-b14a-d79898c7a7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695d9908-a0f8-4305-a234-b52ad7d7db33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:34 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-01ab12ec-0125-47e9-ba40-aa29e101e11b tempest-CreateVolumesFromImageTest-1747582341 None] Created volume successfully. Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695d9908-a0f8-4305-a234-b52ad7d7db33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1940605217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ba289f-a881-4fa8-bf93-3e5f6741147f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c43c479097438e9c178226383ac3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:34Z,use_quota=True,user_id='d0fdd4a11fc34c5f9aeb6169edb99c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0985db8-e6ac-43d9-bc89-1c108a1a26d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0985db8-e6ac-43d9-bc89-1c108a1a26d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182e63a5-0784-4269-b930-380f59d9ef57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182e63a5-0784-4269-b930-380f59d9ef57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7ba289f-a881-4fa8-bf93-3e5f6741147f', 'volume_name': 'volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2014433f-93ab-498c-a0f6-a379803493a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2014433f-93ab-498c-a0f6-a379803493a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdeb68c-1a29-4f56-892a-9912421979d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:34 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Volume b7ba289f-a881-4fa8-bf93-3e5f6741147f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f', 'volume_size': 1} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:34 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8e602330-be7d-4b16-89e2-4c2936232e5a tempest-VolumesActionsTest-424785027 None] Detach volume completed successfully. Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8e602330-be7d-4b16-89e2-4c2936232e5a tempest-VolumesActionsTest-424785027 None] Lock "cinder-ec912df5-7db5-430e-a443-adac8748c076-detach_volume" released by "detach_volume" :: held 0.392s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "cinder-42439b8f-8fee-4577-bd31-78026dbda382-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-42439b8f-8fee-4577-bd31-78026dbda382-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "cinder-quobyte-42439b8f-8fee-4577-bd31-78026dbda382" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-quobyte-42439b8f-8fee-4577-bd31-78026dbda382" acquired by "delete_volume" :: waited 0.043s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b00607-8fce-4987-ba2f-e227c18c5191]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42439b8f-8fee-4577-bd31-78026dbda382 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:35 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Flow 'volume_create_manager' (9a86ced9-2d92-4d53-907d-7923550d27ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69394b0d-fab6-4e37-a8d7-42ab7c5bde85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756 1073741824" returned: 0 in 1.062s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:35 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42439b8f-8fee-4577-bd31-78026dbda382 Sep 21 16:45:35 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69394b0d-fab6-4e37-a8d7-42ab7c5bde85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1325451284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1737ee1-3f8c-419c-9180-e7da84b09150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c43c479097438e9c178226383ac3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:35Z,use_quota=True,user_id='d0fdd4a11fc34c5f9aeb6169edb99c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1393f53-0ebd-41c2-9be5-53655f482471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1393f53-0ebd-41c2-9be5-53655f482471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc834283-e2b0-4c38-ae50-27178017c2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc834283-e2b0-4c38-ae50-27178017c2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1737ee1-3f8c-419c-9180-e7da84b09150', 'volume_name': 'volume-e1737ee1-3f8c-419c-9180-e7da84b09150', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526004b1-ad0f-4b2d-967f-62833a8f4c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526004b1-ad0f-4b2d-967f-62833a8f4c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cca58ea-88fa-488f-8831-86a4b735af43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:35 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Volume e1737ee1-3f8c-419c-9180-e7da84b09150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1737ee1-3f8c-419c-9180-e7da84b09150', 'volume_size': 1} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:35 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756 Sep 21 16:45:35 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:35 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42439b8f-8fee-4577-bd31-78026dbda382" returned: 0 in 0.517s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42439b8f-8fee-4577-bd31-78026dbda382 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:35 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42439b8f-8fee-4577-bd31-78026dbda382 Sep 21 16:45:35 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:35 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756" returned: 0 in 0.527s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.341s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1173725480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa23530a-62b3-420c-b2f1-692e75dfb325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c43c479097438e9c178226383ac3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:33Z,use_quota=True,user_id='d0fdd4a11fc34c5f9aeb6169edb99c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Creating volume aa23530a-62b3-420c-b2f1-692e75dfb325 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:45:35 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:45:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aa23530a-62b3-420c-b2f1-692e75dfb325 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:36 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aa23530a-62b3-420c-b2f1-692e75dfb325 1073741824 Sep 21 16:45:36 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1c575b-e171-4cdf-b297-e53b5d193d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d7680d-0a9f-49a0-993a-7d2049cd21f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:36 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Volume volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756 (dc26ac32-1810-44e0-80b9-ad1f87e7d756): created successfully Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d7680d-0a9f-49a0-993a-7d2049cd21f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Flow 'volume_create_manager' (03ccfb79-d44e-499d-aee6-7891e4c0a69c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:36 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d015a7f2-488c-461b-bb45-d3254fb6830d tempest-CreateVolumesFromImageTest-1747582341 None] Created volume successfully. Sep 21 16:45:36 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-42439b8f-8fee-4577-bd31-78026dbda382" returned: 0 in 0.587s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-quobyte-42439b8f-8fee-4577-bd31-78026dbda382" released by "delete_volume" :: held 1.203s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Created reservations ['f7c30a3d-6b20-49d5-ab78-e319aadee962', '960b21bc-8fb1-4508-8d0c-1eecf3193adb', 'd491559a-d71c-4a21-b54c-e0d177e2106f', '44029dd7-0ab1-484e-9ae5-6cd354006641'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:36 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:36 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:36 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aa23530a-62b3-420c-b2f1-692e75dfb325 1073741824" returned: 0 in 0.687s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aa23530a-62b3-420c-b2f1-692e75dfb325 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:36 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aa23530a-62b3-420c-b2f1-692e75dfb325 Sep 21 16:45:36 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:36 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.412s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:36 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:37 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Deleted volume successfully. Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a8054c9c-d88f-4bc2-9c54-da5f1e4fb478 tempest-ProjectReaderTests-1194987291 None] Lock "cinder-42439b8f-8fee-4577-bd31-78026dbda382-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:37 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aa23530a-62b3-420c-b2f1-692e75dfb325" returned: 0 in 0.414s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.463s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1940605217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ba289f-a881-4fa8-bf93-3e5f6741147f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c43c479097438e9c178226383ac3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:34Z,use_quota=True,user_id='d0fdd4a11fc34c5f9aeb6169edb99c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Creating volume b7ba289f-a881-4fa8-bf93-3e5f6741147f {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:45:37 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:37 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f 1073741824 Sep 21 16:45:37 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7645f283-8a8f-40b4-b357-3a137eb22630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa23530a-62b3-420c-b2f1-692e75dfb325', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9887f0c3-5c9b-4320-b864-2750f4175a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:37 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Volume volume-aa23530a-62b3-420c-b2f1-692e75dfb325 (aa23530a-62b3-420c-b2f1-692e75dfb325): created successfully Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9887f0c3-5c9b-4320-b864-2750f4175a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Flow 'volume_create_manager' (10dd0115-1207-4ebc-aec1-8be1101b51e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:37 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-497ecdda-0853-4beb-a559-d28500cd3696 tempest-CreateVolumesFromImageTest-1747582341 None] Created volume successfully. Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Flow 'volume_create_manager' (3c15988a-ab9f-4a84-9ef8-5c4223c95f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0dc3380-fe56-4d19-840e-cadf142ea32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0dc3380-fe56-4d19-840e-cadf142ea32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1735236963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999e9c34-9d71-497b-a076-6fd0d09f6972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b322cf6e26eb49d999f7c7584a307973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:38Z,use_quota=True,user_id='08b495d514d749f386a761b30708f6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b281688-20d8-4946-8b86-1660a2dae8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b281688-20d8-4946-8b86-1660a2dae8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0231312c-2a00-45cf-96ff-e408199dedf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0231312c-2a00-45cf-96ff-e408199dedf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '999e9c34-9d71-497b-a076-6fd0d09f6972', 'volume_name': 'volume-999e9c34-9d71-497b-a076-6fd0d09f6972', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45142633-c306-4162-9cd5-6634796227dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45142633-c306-4162-9cd5-6634796227dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3760c2-61cd-4195-bf77-2e1f893ed760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:37 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Volume 999e9c34-9d71-497b-a076-6fd0d09f6972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-999e9c34-9d71-497b-a076-6fd0d09f6972', 'volume_size': 1} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:37 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f 1073741824" returned: 0 in 0.704s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:37 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f Sep 21 16:45:37 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:38 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f" returned: 0 in 0.263s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.778s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1325451284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1737ee1-3f8c-419c-9180-e7da84b09150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c43c479097438e9c178226383ac3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:35Z,use_quota=True,user_id='d0fdd4a11fc34c5f9aeb6169edb99c7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Creating volume e1737ee1-3f8c-419c-9180-e7da84b09150 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:45:38 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e1737ee1-3f8c-419c-9180-e7da84b09150 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdeb68c-1a29-4f56-892a-9912421979d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:38 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e1737ee1-3f8c-419c-9180-e7da84b09150 1073741824 Sep 21 16:45:38 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be07cdd3-c187-4ba8-add1-ac0cb236b6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:38 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Volume volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f (b7ba289f-a881-4fa8-bf93-3e5f6741147f): created successfully Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be07cdd3-c187-4ba8-add1-ac0cb236b6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Flow 'volume_create_manager' (7a4bac73-4b41-4425-b14a-d79898c7a7a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:38 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a9a194b0-7aac-4443-9074-c3aa525e66c4 tempest-CreateVolumesFromImageTest-1747582341 None] Created volume successfully. Sep 21 16:45:38 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e1737ee1-3f8c-419c-9180-e7da84b09150 1073741824" returned: 0 in 0.668s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e1737ee1-3f8c-419c-9180-e7da84b09150 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:38 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e1737ee1-3f8c-419c-9180-e7da84b09150 Sep 21 16:45:38 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:39 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e1737ee1-3f8c-419c-9180-e7da84b09150" returned: 0 in 0.280s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.364s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1735236963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=999e9c34-9d71-497b-a076-6fd0d09f6972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b322cf6e26eb49d999f7c7584a307973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:38Z,use_quota=True,user_id='08b495d514d749f386a761b30708f6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Creating volume 999e9c34-9d71-497b-a076-6fd0d09f6972 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:45:39 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-999e9c34-9d71-497b-a076-6fd0d09f6972 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cca58ea-88fa-488f-8831-86a4b735af43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1737ee1-3f8c-419c-9180-e7da84b09150', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90744491-1afd-4862-a26c-0601c1a49a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:39 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-999e9c34-9d71-497b-a076-6fd0d09f6972 1073741824 Sep 21 16:45:39 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:39 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Volume volume-e1737ee1-3f8c-419c-9180-e7da84b09150 (e1737ee1-3f8c-419c-9180-e7da84b09150): created successfully Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90744491-1afd-4862-a26c-0601c1a49a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Flow 'volume_create_manager' (9a86ced9-2d92-4d53-907d-7923550d27ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:39 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0aea1d58-50c6-435b-81a2-476820e8d25d tempest-CreateVolumesFromImageTest-1747582341 None] Created volume successfully. Sep 21 16:45:39 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-999e9c34-9d71-497b-a076-6fd0d09f6972 1073741824" returned: 0 in 0.587s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-999e9c34-9d71-497b-a076-6fd0d09f6972 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "cinder-e1737ee1-3f8c-419c-9180-e7da84b09150-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:39 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-999e9c34-9d71-497b-a076-6fd0d09f6972 Sep 21 16:45:39 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-e1737ee1-3f8c-419c-9180-e7da84b09150-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "cinder-quobyte-e1737ee1-3f8c-419c-9180-e7da84b09150" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-quobyte-e1737ee1-3f8c-419c-9180-e7da84b09150" acquired by "delete_volume" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea155af-6e73-4a64-a952-146348ec3fff]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e1737ee1-3f8c-419c-9180-e7da84b09150 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:40 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e1737ee1-3f8c-419c-9180-e7da84b09150 Sep 21 16:45:40 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:40 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-999e9c34-9d71-497b-a076-6fd0d09f6972" returned: 0 in 0.294s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3760c2-61cd-4195-bf77-2e1f893ed760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999e9c34-9d71-497b-a076-6fd0d09f6972', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b42be4-e11e-40f7-a5d6-9b26df77c3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:40 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Volume volume-999e9c34-9d71-497b-a076-6fd0d09f6972 (999e9c34-9d71-497b-a076-6fd0d09f6972): created successfully Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b42be4-e11e-40f7-a5d6-9b26df77c3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Flow 'volume_create_manager' (3c15988a-ab9f-4a84-9ef8-5c4223c95f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:40 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fb4b964c-5c47-400b-91cc-89521129d438 tempest-VolumesMetadataTest-422103891 None] Created volume successfully. Sep 21 16:45:40 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e1737ee1-3f8c-419c-9180-e7da84b09150" returned: 0 in 0.411s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e1737ee1-3f8c-419c-9180-e7da84b09150 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:40 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e1737ee1-3f8c-419c-9180-e7da84b09150 Sep 21 16:45:40 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c533dc57-da10-4bd8-89b0-71d9976d0813]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:40 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 Sep 21 16:45:40 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:40 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e1737ee1-3f8c-419c-9180-e7da84b09150" returned: 0 in 0.271s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-quobyte-e1737ee1-3f8c-419c-9180-e7da84b09150" released by "delete_volume" :: held 0.728s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Created reservations ['7a52604c-4a1b-4c24-af06-9ac6f9d0d9b3', '049a904c-a2db-4714-917e-c24323e129f9', '2d5782cf-8280-4c09-9075-ac7dcf24370f', '4f3f3a82-8753-4656-b4f9-b61aebe405a0'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:40 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:40 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:40 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076" returned: 0 in 0.427s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff8bef3-54cf-4548-8b0a-26593a2fa805]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "cinder-b7ba289f-a881-4fa8-bf93-3e5f6741147f-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:41 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 Sep 21 16:45:41 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-b7ba289f-a881-4fa8-bf93-3e5f6741147f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "cinder-quobyte-b7ba289f-a881-4fa8-bf93-3e5f6741147f" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-quobyte-b7ba289f-a881-4fa8-bf93-3e5f6741147f" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:41 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.353s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:41 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Deleted volume successfully. Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2fe7544a-d35e-4168-a942-07431ef5dc9e tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-e1737ee1-3f8c-419c-9180-e7da84b09150-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4535c0e-d067-4e52-bc0d-e81696fe5ac4]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:41 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f Sep 21 16:45:41 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:41 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076" returned: 0 in 0.486s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.4becd198-5c47-4a88-b0bb-c9a3d204d5363qv3azot.img {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:41 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.4becd198-5c47-4a88-b0bb-c9a3d204d5363qv3azot.img Sep 21 16:45:41 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:41 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f" returned: 0 in 0.457s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:41 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f Sep 21 16:45:41 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Acquiring lock "cinder-999e9c34-9d71-497b-a076-6fd0d09f6972-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Lock "cinder-999e9c34-9d71-497b-a076-6fd0d09f6972-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Acquiring lock "cinder-quobyte-999e9c34-9d71-497b-a076-6fd0d09f6972" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Lock "cinder-quobyte-999e9c34-9d71-497b-a076-6fd0d09f6972" acquired by "delete_volume" :: waited 0.032s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:42 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[301d4eca-40b5-457a-98b6-6977cd03e05e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-999e9c34-9d71-497b-a076-6fd0d09f6972 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:42 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b7ba289f-a881-4fa8-bf93-3e5f6741147f" returned: 0 in 0.592s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-quobyte-b7ba289f-a881-4fa8-bf93-3e5f6741147f" released by "delete_volume" :: held 1.143s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:42 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Created reservations ['2f92c730-4b2a-4196-a377-2444c4d95d12', '9c324347-f249-48c4-b8a2-86ca0d8487c4', '0a280a78-4b30-4744-8a5a-45e71cea6f68', 'b61a1a79-801d-4f63-8536-d8074a4b47a3'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:42 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-999e9c34-9d71-497b-a076-6fd0d09f6972 Sep 21 16:45:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:42 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:42 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:42 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:42 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:42 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-999e9c34-9d71-497b-a076-6fd0d09f6972" returned: 0 in 0.776s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-999e9c34-9d71-497b-a076-6fd0d09f6972 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.491s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Deleted volume successfully. Sep 21 16:45:43 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-999e9c34-9d71-497b-a076-6fd0d09f6972 Sep 21 16:45:43 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c684f973-bac0-4ec4-82b4-3c7fb059b31f tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-b7ba289f-a881-4fa8-bf93-3e5f6741147f-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "cinder-aa23530a-62b3-420c-b2f1-692e75dfb325-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-aa23530a-62b3-420c-b2f1-692e75dfb325-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "cinder-quobyte-aa23530a-62b3-420c-b2f1-692e75dfb325" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:43 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-quobyte-aa23530a-62b3-420c-b2f1-692e75dfb325" acquired by "delete_volume" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-999e9c34-9d71-497b-a076-6fd0d09f6972" returned: 0 in 0.568s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Lock "cinder-quobyte-999e9c34-9d71-497b-a076-6fd0d09f6972" released by "delete_volume" :: held 1.479s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7d37a1-bcf8-4452-b988-b02bcc021011]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aa23530a-62b3-420c-b2f1-692e75dfb325 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Created reservations ['bccfc9fb-c7aa-46c2-a92a-18c9d34090cc', '9b762aa7-51ed-4855-8448-5506b3e6e155', '274679ca-186a-4e22-b3a3-f415d4dddf82', 'd877d62d-551d-4f3f-91d0-02d5c95ed9ff'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:43 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aa23530a-62b3-420c-b2f1-692e75dfb325 Sep 21 16:45:43 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:43 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:43 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:44 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.305s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:44 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:44 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Deleted volume successfully. Sep 21 16:45:44 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fa0f2a24-f734-4d3e-8e6e-f3065e3616d6 tempest-VolumesMetadataTest-422103891 None] Lock "cinder-999e9c34-9d71-497b-a076-6fd0d09f6972-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aa23530a-62b3-420c-b2f1-692e75dfb325" returned: 0 in 0.620s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aa23530a-62b3-420c-b2f1-692e75dfb325 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:44 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aa23530a-62b3-420c-b2f1-692e75dfb325 Sep 21 16:45:44 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:44 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aa23530a-62b3-420c-b2f1-692e75dfb325" returned: 0 in 0.533s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-quobyte-aa23530a-62b3-420c-b2f1-692e75dfb325" released by "delete_volume" :: held 1.279s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:44 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Created reservations ['a147fb0e-1d0d-4d97-8ee4-75889aafe1c5', '2d707f77-fb90-475e-9e11-eec3143ea134', '6c0637c2-691e-46f2-b51d-0cf8f1b69436', 'b9588e96-43bd-4437-871a-ef34bd6615b5'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:45 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:45 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:45 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.351s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:45 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Deleted volume successfully. Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b2ebbfb6-d771-44a1-aec4-4e1557485413 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-aa23530a-62b3-420c-b2f1-692e75dfb325-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "cinder-dc26ac32-1810-44e0-80b9-ad1f87e7d756-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-dc26ac32-1810-44e0-80b9-ad1f87e7d756-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "cinder-quobyte-dc26ac32-1810-44e0-80b9-ad1f87e7d756" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-quobyte-dc26ac32-1810-44e0-80b9-ad1f87e7d756" acquired by "delete_volume" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ac04f3-39db-4230-b24f-ae7c2985eb83]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:46 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756 Sep 21 16:45:46 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:46 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756" returned: 0 in 0.725s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:46 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756 Sep 21 16:45:46 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:47 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dc26ac32-1810-44e0-80b9-ad1f87e7d756" returned: 0 in 0.401s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-quobyte-dc26ac32-1810-44e0-80b9-ad1f87e7d756" released by "delete_volume" :: held 1.233s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:47 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Created reservations ['dfc1e6c9-7efd-4529-b547-a5221ef321c1', 'de21b73b-7381-48a9-a30e-6763cc3ee27f', 'b54d65e9-8ee7-48cf-aac7-e7e2e746b274', 'c3b27838-5e77-4e5c-8805-e7240fa3f47c'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:47 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:47 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:47 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.510s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:47 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:47 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Deleted volume successfully. Sep 21 16:45:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-842ac40c-7823-4758-bf6f-5dd595d83d83 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-dc26ac32-1810-44e0-80b9-ad1f87e7d756-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "cinder-f2b912eb-9440-4963-a813-c2379fc7e395-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-f2b912eb-9440-4963-a813-c2379fc7e395-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "cinder-quobyte-f2b912eb-9440-4963-a813-c2379fc7e395" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:45:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-quobyte-f2b912eb-9440-4963-a813-c2379fc7e395" acquired by "delete_volume" :: waited 0.030s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:45:48 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af879f5-038b-45dd-823e-c57a06efff43]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f2b912eb-9440-4963-a813-c2379fc7e395 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:48 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f2b912eb-9440-4963-a813-c2379fc7e395 Sep 21 16:45:48 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:49 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f2b912eb-9440-4963-a813-c2379fc7e395" returned: 0 in 0.905s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f2b912eb-9440-4963-a813-c2379fc7e395 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:49 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f2b912eb-9440-4963-a813-c2379fc7e395 Sep 21 16:45:49 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:49 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.4becd198-5c47-4a88-b0bb-c9a3d204d5363qv3azot.img" returned: 0 in 7.946s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c17d77-5cbb-40ba-a4f4-1df88070fba0]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:49 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 Sep 21 16:45:49 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:49 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f2b912eb-9440-4963-a813-c2379fc7e395" returned: 0 in 0.266s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-quobyte-f2b912eb-9440-4963-a813-c2379fc7e395" released by "delete_volume" :: held 1.251s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Created reservations ['519cbaec-1cde-4c00-935f-7703142c23c2', '43126f0d-e37d-4d34-aa99-a90da2e32016', 'e4705e60-af56-4142-a3a3-64251036f0c0', 'e28d5ed1-1ec8-40b0-9e33-f46420059c7e'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:45:49 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:45:49 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:45:49 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076" returned: 0 in 0.571s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.4becd198-5c47-4a88-b0bb-c9a3d204d5363qv3azot.img {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:45:49 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] Converted 1024.00 MB image at 128.83 MB/s Sep 21 16:45:49 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] 4becd198-5c47-4a88-b0bb-c9a3d204d536 was raw, no need to convert to raw {{(pid=86030) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 21 16:45:50 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Sep 21 16:45:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.294s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:45:50 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:45:50 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Deleted volume successfully. Sep 21 16:45:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fe792e46-cfe7-4b63-897e-22d1495d23a9 tempest-CreateVolumesFromImageTest-1747582341 None] Lock "cinder-f2b912eb-9440-4963-a813-c2379fc7e395-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:45:52 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Flow 'volume_create_manager' (4534f64e-9c9e-44f2-a275-5a974b099f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fb85ca-754c-4df0-8942-ec10788b60be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fb85ca-754c-4df0-8942-ec10788b60be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1578466103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f33470e-b8d7-4b8a-baa4-c3b53fe255b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4b754523434558a83b3ce93211c50b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:53Z,use_quota=True,user_id='4f92ef22c9fd48ca97f220f599408a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6655dbe-d2fb-4230-b444-79fc5bb1263a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6655dbe-d2fb-4230-b444-79fc5bb1263a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8636c69-a006-4d0b-b023-56ac946757d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8636c69-a006-4d0b-b023-56ac946757d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f33470e-b8d7-4b8a-baa4-c3b53fe255b3', 'volume_name': 'volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef84f837-d59d-4a3e-bb4b-ff440e7a0e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef84f837-d59d-4a3e-bb4b-ff440e7a0e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:52 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1608a4-c078-4fe8-89a9-0d09fa97583d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:52 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Volume 1f33470e-b8d7-4b8a-baa4-c3b53fe255b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3', 'volume_size': 1} Sep 21 16:45:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:45:54 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:45:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Flow 'volume_create_manager' (49035c49-0412-4dab-bdde-28d5da224674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:45:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd640b21-52e8-4b7d-84be-26e95ed36f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd640b21-52e8-4b7d-84be-26e95ed36f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1683468579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454d1b58-27c4-49a4-8f56-5bf8d062af2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60d21e95931494da3c46e9698c6123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:54Z,use_quota=True,user_id='37aef042bb194e79851ebb554fec464e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05116c8d-315f-4cbe-9400-e99fea651ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05116c8d-315f-4cbe-9400-e99fea651ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52490928-384c-4dbd-b28a-0a52a93f7aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52490928-384c-4dbd-b28a-0a52a93f7aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '454d1b58-27c4-49a4-8f56-5bf8d062af2e', 'volume_name': 'volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6877ff-5483-4e3a-b6e5-613a70e054fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6877ff-5483-4e3a-b6e5-613a70e054fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:45:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cc7022-d734-4eda-8fcb-2e2032a2c569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:45:54 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume 454d1b58-27c4-49a4-8f56-5bf8d062af2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e', 'volume_size': 1} Sep 21 16:45:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:04 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=51,cinder:INSERT=15,cinder:UPDATE=83,cinder:DELETE=8 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:46:04 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=76,cinder:SELECT=63,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:46:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:46:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:07 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:07 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:08 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.286s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:46:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 28 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:46:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:46:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.551s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:09 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] Uploaded volume to glance image-id: 4becd198-5c47-4a88-b0bb-c9a3d204d536. {{(pid=86030) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 21 16:46:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.246s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1578466103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f33470e-b8d7-4b8a-baa4-c3b53fe255b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4b754523434558a83b3ce93211c50b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:53Z,use_quota=True,user_id='4f92ef22c9fd48ca97f220f599408a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Creating volume 1f33470e-b8d7-4b8a-baa4-c3b53fe255b3 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:09 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:10 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3 1073741824 Sep 21 16:46:10 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:10 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3711e930-bfa4-4a83-bf5b-ffc50416bacb tempest-VolumesActionsTest-424785027 None] Copy volume to image completed successfully. Sep 21 16:46:10 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3 1073741824" returned: 0 in 0.440s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:10 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3 Sep 21 16:46:10 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:10 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3" returned: 0 in 0.259s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.510s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1683468579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454d1b58-27c4-49a4-8f56-5bf8d062af2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60d21e95931494da3c46e9698c6123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:45:54Z,use_quota=True,user_id='37aef042bb194e79851ebb554fec464e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Creating volume 454d1b58-27c4-49a4-8f56-5bf8d062af2e {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:10 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1608a4-c078-4fe8-89a9-0d09fa97583d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:10 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e 1073741824 Sep 21 16:46:10 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28192c1-6da3-4926-a05e-8959a8f9be6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:10 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Volume volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3 (1f33470e-b8d7-4b8a-baa4-c3b53fe255b3): created successfully Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28192c1-6da3-4926-a05e-8959a8f9be6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Flow 'volume_create_manager' (4534f64e-9c9e-44f2-a275-5a974b099f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:10 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-28372c50-0094-4279-9167-9b7c97b78bbc tempest-VolumesTransfersV357Test-2147047254 None] Created volume successfully. Sep 21 16:46:11 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e 1073741824" returned: 0 in 0.479s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:11 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e Sep 21 16:46:11 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:11 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e" returned: 0 in 0.265s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cc7022-d734-4eda-8fcb-2e2032a2c569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d116303-2729-4881-8543-4172780a0414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b39be9-bb24-4ed0-acf3-f44195dcd633]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:11 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e (454d1b58-27c4-49a4-8f56-5bf8d062af2e): created successfully Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d116303-2729-4881-8543-4172780a0414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Flow 'volume_create_manager' (49035c49-0412-4dab-bdde-28d5da224674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:11 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c1770580-97d6-461a-9a49-c23c48aefb4b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Created volume successfully. Sep 21 16:46:11 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 Sep 21 16:46:11 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:11 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076" returned: 0 in 0.384s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae78f60-f2d3-4c83-b8db-f8aff1e2deb7]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:12 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 Sep 21 16:46:12 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:12 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076" returned: 0 in 0.442s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:12 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img Sep 21 16:46:12 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:12 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6f7b1bd3-928b-434d-bc0b-1d5361a9d124 tempest-VolumesTransfersV357Test-137621587 None] Transfer volume completed successfully. Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Flow 'volume_create_manager' (e6e67755-7a84-4133-afae-af505e031a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5374d9-c42e-4271-9872-876d5c2b11a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5374d9-c42e-4271-9872-876d5c2b11a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239769488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f51223f-7f7a-4d39-9a5e-88af0128f039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60d21e95931494da3c46e9698c6123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:13Z,use_quota=True,user_id='37aef042bb194e79851ebb554fec464e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88daa03-384b-4221-aed4-5095b50ad33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88daa03-384b-4221-aed4-5095b50ad33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b383eb2a-5573-48bd-8ba7-60c7c7ff5e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b383eb2a-5573-48bd-8ba7-60c7c7ff5e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f51223f-7f7a-4d39-9a5e-88af0128f039', 'volume_name': 'volume-6f51223f-7f7a-4d39-9a5e-88af0128f039', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6976394a-518a-4b48-b25a-5a873f0cfa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6976394a-518a-4b48-b25a-5a873f0cfa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9715963-58dd-4f3e-8c48-bc9500ac40d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:12 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume 6f51223f-7f7a-4d39-9a5e-88af0128f039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f51223f-7f7a-4d39-9a5e-88af0128f039', 'volume_size': 1} Sep 21 16:46:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Acquiring lock "cinder-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Lock "cinder-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Acquiring lock "cinder-quobyte-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Lock "cinder-quobyte-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3" acquired by "delete_volume" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:13 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[836d05a8-4b52-41ed-801c-27019068e284]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:13 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3 Sep 21 16:46:13 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:13 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Flow 'volume_create_manager' (b44282a1-9731-4291-8a96-b64ad0702dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4426e0-b80f-4028-bb31-156494f4b4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4426e0-b80f-4028-bb31-156494f4b4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1496202939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374f2f6c-9693-47d3-9a24-e7cb2071a2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60d21e95931494da3c46e9698c6123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:14Z,use_quota=True,user_id='37aef042bb194e79851ebb554fec464e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43588fdb-2dec-49c6-be6a-268a108c584a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43588fdb-2dec-49c6-be6a-268a108c584a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e09cf3-df39-4aff-abe2-2af7bfd2edbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e09cf3-df39-4aff-abe2-2af7bfd2edbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '374f2f6c-9693-47d3-9a24-e7cb2071a2b2', 'volume_name': 'volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddb7106-5899-4996-9fe9-91d8a0d8355e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddb7106-5899-4996-9fe9-91d8a0d8355e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d781cb8-0817-424f-b24f-f607f8b2b3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:14 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume 374f2f6c-9693-47d3-9a24-e7cb2071a2b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2', 'volume_size': 1} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:14 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3" returned: 0 in 0.712s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:14 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3 Sep 21 16:46:14 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Flow 'volume_create_manager' (2c27f588-47bc-4c94-abc0-3332723adf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc31e36e-bd42-44b0-bdfe-132cefe25bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc31e36e-bd42-44b0-bdfe-132cefe25bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-31103982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f60743-7389-475f-b7e5-5986ec629526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60d21e95931494da3c46e9698c6123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:14Z,use_quota=True,user_id='37aef042bb194e79851ebb554fec464e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a59a3ba-11de-4823-838b-b5abb0cfa44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a59a3ba-11de-4823-838b-b5abb0cfa44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9372407e-6cba-4f0d-8400-bc713806c510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9372407e-6cba-4f0d-8400-bc713806c510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4f60743-7389-475f-b7e5-5986ec629526', 'volume_name': 'volume-b4f60743-7389-475f-b7e5-5986ec629526', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b2f1eb-8081-4164-8143-ba9d9f621603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b2f1eb-8081-4164-8143-ba9d9f621603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a411b00-e13a-46bf-b21f-91cf94218804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:14 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume b4f60743-7389-475f-b7e5-5986ec629526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4f60743-7389-475f-b7e5-5986ec629526', 'volume_size': 1} Sep 21 16:46:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:15 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3" returned: 0 in 0.810s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Lock "cinder-quobyte-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3" released by "delete_volume" :: held 1.647s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Created reservations ['a9ab100f-5fb7-4818-ab33-af15bad2a449', '37f39138-5344-4e04-a41e-40537e0057d2', 'c4a0c1b0-d0b5-4f88-a798-e0c68472297f', '844bb198-4cd5-422e-bd8e-c499f534f47a'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Flow 'volume_create_manager' (f938a2ec-bc5c-436c-8120-e73219dff541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df63976f-9a07-4ff3-94fd-48b5944f895a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df63976f-9a07-4ff3-94fd-48b5944f895a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-430620034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8671c847-b971-422b-892f-8465725c8f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60d21e95931494da3c46e9698c6123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:15Z,use_quota=True,user_id='37aef042bb194e79851ebb554fec464e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9078f0b-3f69-4bb8-8727-e0efd49ed040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9078f0b-3f69-4bb8-8727-e0efd49ed040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c20f9e7-78df-41b1-9996-94d99a861f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c20f9e7-78df-41b1-9996-94d99a861f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8671c847-b971-422b-892f-8465725c8f89', 'volume_name': 'volume-8671c847-b971-422b-892f-8465725c8f89', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0de8e5c-fba5-4d05-a6ff-da91a45849a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0de8e5c-fba5-4d05-a6ff-da91a45849a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bc0fc1-80bd-4c6a-8bdf-b35c41468681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:15 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume 8671c847-b971-422b-892f-8465725c8f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8671c847-b971-422b-892f-8465725c8f89', 'volume_size': 1} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:15 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:15 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:16 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.690s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:16 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Deleted volume successfully. Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Flow 'volume_create_manager' (813eb54c-cf86-4a01-ac83-2b22fce26d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad75cf3-5d43-4345-8678-cf334a6a1483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad75cf3-5d43-4345-8678-cf334a6a1483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211973081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe64435e-e7c5-49a1-ac9b-b5463d077d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60d21e95931494da3c46e9698c6123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:16Z,use_quota=True,user_id='37aef042bb194e79851ebb554fec464e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8282765c-9c52-4e30-af6d-ef5828c9065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8282765c-9c52-4e30-af6d-ef5828c9065d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3da7fd-b9e3-4b67-ae6b-9f1bbaaf1a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3da7fd-b9e3-4b67-ae6b-9f1bbaaf1a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe64435e-e7c5-49a1-ac9b-b5463d077d7f', 'volume_name': 'volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb78810d-5402-4320-82c0-17baa883ee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb78810d-5402-4320-82c0-17baa883ee09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb22874-3579-4031-b25d-15ba1021d460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:16 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume fe64435e-e7c5-49a1-ac9b-b5463d077d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f', 'volume_size': 1} Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:16 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-cf02923b-7739-4a21-9f02-3ab770837b5f tempest-VolumesTransfersV357Test-1926925090 None] Lock "cinder-1f33470e-b8d7-4b8a-baa4-c3b53fe255b3-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:17 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Flow 'volume_create_manager' (9381a24a-f5d0-4334-bafe-eb53afc40ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d783068-9699-4935-b5f8-d22cda4e20cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d783068-9699-4935-b5f8-d22cda4e20cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-153284560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadaa593-2f01-4297-86bb-07fd753ce16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4b754523434558a83b3ce93211c50b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:17Z,use_quota=True,user_id='4f92ef22c9fd48ca97f220f599408a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1f2c56-096a-4a10-99ff-49e01057fc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1f2c56-096a-4a10-99ff-49e01057fc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f2f724-4d61-43c7-b252-2837385ae069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f2f724-4d61-43c7-b252-2837385ae069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dadaa593-2f01-4297-86bb-07fd753ce16f', 'volume_name': 'volume-dadaa593-2f01-4297-86bb-07fd753ce16f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfe5609-a2ec-4cf1-8ec8-db276e661f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfe5609-a2ec-4cf1-8ec8-db276e661f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f681bb-76b2-40e7-a6c3-7900a4ddd7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:17 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Volume dadaa593-2f01-4297-86bb-07fd753ce16f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dadaa593-2f01-4297-86bb-07fd753ce16f', 'volume_size': 1} Sep 21 16:46:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:20 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img" returned: 0 in 7.740s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:20 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4e9ffc-a30e-4007-a518-c878c915599c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:20 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 Sep 21 16:46:20 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:20 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076" returned: 0 in 0.525s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:20 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076, size 1024.00 MB, duration 7.74 sec, destination /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:46:20 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Converted 1024.00 MB image at 132.29 MB/s Sep 21 16:46:20 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] 0903084b-bd08-4e93-b6d8-dc50738c9c78 was raw, converting to qcow2 {{(pid=86030) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 21 16:46:20 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5ee17e-c196-4218-af66-449c9c5e42a0]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:20 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img Sep 21 16:46:20 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:21 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img" returned: 0 in 0.321s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:21 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img Sep 21 16:46:21 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:21 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img" returned: 1 in 0.316s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:46:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img /opt/stack/data/cinder/conversion/vol_upload_mc1ztfh_ {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:21 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img /opt/stack/data/cinder/conversion/vol_upload_mc1ztfh_ Sep 21 16:46:21 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:21 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img /opt/stack/data/cinder/conversion/vol_upload_mc1ztfh_" returned: 0 in 0.272s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:21 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Image conversion details: src /opt/stack/data/cinder/conversion/ec912df5-7db5-430e-a443-adac8748c076.temp_image.0903084b-bd08-4e93-b6d8-dc50738c9c78bpmswnoe.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_mc1ztfh_ {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:46:21 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 21 16:46:21 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2eb832-4bce-4143-9a91-5797bca435c8]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mc1ztfh_ {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:21 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mc1ztfh_ Sep 21 16:46:21 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:22 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mc1ztfh_" returned: 0 in 0.327s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.683s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Uploaded volume to glance image-id: 0903084b-bd08-4e93-b6d8-dc50738c9c78. {{(pid=86030) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.323s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239769488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f51223f-7f7a-4d39-9a5e-88af0128f039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60d21e95931494da3c46e9698c6123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:13Z,use_quota=True,user_id='37aef042bb194e79851ebb554fec464e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Creating volume 6f51223f-7f7a-4d39-9a5e-88af0128f039 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:23 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6f51223f-7f7a-4d39-9a5e-88af0128f039 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:23 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6f51223f-7f7a-4d39-9a5e-88af0128f039 1073741824 Sep 21 16:46:23 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:23 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-9460213e-061c-4f1f-93f9-7588393d126d tempest-VolumesActionsTest-424785027 None] Copy volume to image completed successfully. Sep 21 16:46:23 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6f51223f-7f7a-4d39-9a5e-88af0128f039 1073741824" returned: 0 in 0.449s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6f51223f-7f7a-4d39-9a5e-88af0128f039 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:23 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6f51223f-7f7a-4d39-9a5e-88af0128f039 Sep 21 16:46:23 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:24 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6f51223f-7f7a-4d39-9a5e-88af0128f039" returned: 0 in 0.282s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.915s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1496202939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374f2f6c-9693-47d3-9a24-e7cb2071a2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60d21e95931494da3c46e9698c6123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:14Z,use_quota=True,user_id='37aef042bb194e79851ebb554fec464e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Creating volume 374f2f6c-9693-47d3-9a24-e7cb2071a2b2 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:24 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9715963-58dd-4f3e-8c48-bc9500ac40d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f51223f-7f7a-4d39-9a5e-88af0128f039', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ee534f-239b-4e59-a46f-f568c56349a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:24 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2 1073741824 Sep 21 16:46:24 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:24 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume volume-6f51223f-7f7a-4d39-9a5e-88af0128f039 (6f51223f-7f7a-4d39-9a5e-88af0128f039): created successfully Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ee534f-239b-4e59-a46f-f568c56349a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Flow 'volume_create_manager' (e6e67755-7a84-4133-afae-af505e031a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:24 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-adc53b83-c2b1-4b39-8992-2725d9fefc63 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Created volume successfully. Sep 21 16:46:24 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2 1073741824" returned: 0 in 0.507s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:24 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2 Sep 21 16:46:24 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:24 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2" returned: 0 in 0.280s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.158s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-31103982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f60743-7389-475f-b7e5-5986ec629526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60d21e95931494da3c46e9698c6123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:14Z,use_quota=True,user_id='37aef042bb194e79851ebb554fec464e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Creating volume b4f60743-7389-475f-b7e5-5986ec629526 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:24 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4f60743-7389-475f-b7e5-5986ec629526 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d781cb8-0817-424f-b24f-f607f8b2b3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:24 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4f60743-7389-475f-b7e5-5986ec629526 1073741824 Sep 21 16:46:24 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afa82a0-700f-47cc-833a-0bdd7b9d83bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:24 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2 (374f2f6c-9693-47d3-9a24-e7cb2071a2b2): created successfully Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afa82a0-700f-47cc-833a-0bdd7b9d83bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Flow 'volume_create_manager' (b44282a1-9731-4291-8a96-b64ad0702dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:24 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-f2b0a40c-3650-44f5-933d-b0d73ff8b523 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Created volume successfully. Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Acquiring lock "cinder-ec912df5-7db5-430e-a443-adac8748c076-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Lock "cinder-ec912df5-7db5-430e-a443-adac8748c076-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Acquiring lock "cinder-quobyte-ec912df5-7db5-430e-a443-adac8748c076" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Lock "cinder-quobyte-ec912df5-7db5-430e-a443-adac8748c076" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c42627-e9a7-4125-8043-050ab8dae238]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:25 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 Sep 21 16:46:25 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:25 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4f60743-7389-475f-b7e5-5986ec629526 1073741824" returned: 0 in 0.454s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4f60743-7389-475f-b7e5-5986ec629526 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:25 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4f60743-7389-475f-b7e5-5986ec629526 Sep 21 16:46:25 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:25 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076" returned: 0 in 0.414s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:25 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076 Sep 21 16:46:25 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:25 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4f60743-7389-475f-b7e5-5986ec629526" returned: 0 in 0.282s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.173s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-430620034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8671c847-b971-422b-892f-8465725c8f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60d21e95931494da3c46e9698c6123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:15Z,use_quota=True,user_id='37aef042bb194e79851ebb554fec464e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Creating volume 8671c847-b971-422b-892f-8465725c8f89 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:25 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8671c847-b971-422b-892f-8465725c8f89 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:25 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8671c847-b971-422b-892f-8465725c8f89 1073741824 Sep 21 16:46:25 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a411b00-e13a-46bf-b21f-91cf94218804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f60743-7389-475f-b7e5-5986ec629526', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994dda71-0056-49c0-9be6-617f786349e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:25 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume volume-b4f60743-7389-475f-b7e5-5986ec629526 (b4f60743-7389-475f-b7e5-5986ec629526): created successfully Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994dda71-0056-49c0-9be6-617f786349e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Flow 'volume_create_manager' (2c27f588-47bc-4c94-abc0-3332723adf30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:25 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b4e7057c-769e-435c-ace9-f0e66410eb76 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Created volume successfully. Sep 21 16:46:25 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-ec912df5-7db5-430e-a443-adac8748c076" returned: 0 in 0.290s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Lock "cinder-quobyte-ec912df5-7db5-430e-a443-adac8748c076" released by "delete_volume" :: held 0.754s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Created reservations ['45073a11-6f8b-4ab5-91e8-0d9bfd9f6db1', '6f8c35d6-4343-459d-a0ab-eaf569b888f3', '3ec1fa3f-c013-4f81-9546-c45b94d9c7a2', '790badc5-7ea4-48fd-a8ec-43bba70c5539'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:26 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:26 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:26 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8671c847-b971-422b-892f-8465725c8f89 1073741824" returned: 0 in 0.526s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:26 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.278s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8671c847-b971-422b-892f-8465725c8f89 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Deleted volume successfully. Sep 21 16:46:26 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8671c847-b971-422b-892f-8465725c8f89 Sep 21 16:46:26 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0644b851-85fe-44f6-9791-61ea3d811b33 tempest-VolumesActionsTest-424785027 None] Lock "cinder-ec912df5-7db5-430e-a443-adac8748c076-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:26 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8671c847-b971-422b-892f-8465725c8f89" returned: 0 in 0.265s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.084s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211973081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe64435e-e7c5-49a1-ac9b-b5463d077d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60d21e95931494da3c46e9698c6123f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:16Z,use_quota=True,user_id='37aef042bb194e79851ebb554fec464e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Creating volume fe64435e-e7c5-49a1-ac9b-b5463d077d7f {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:26 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bc0fc1-80bd-4c6a-8bdf-b35c41468681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8671c847-b971-422b-892f-8465725c8f89', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907651df-dff1-4536-ba3d-48f5c33b7b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:26 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f 1073741824 Sep 21 16:46:26 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:26 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume volume-8671c847-b971-422b-892f-8465725c8f89 (8671c847-b971-422b-892f-8465725c8f89): created successfully Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907651df-dff1-4536-ba3d-48f5c33b7b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Flow 'volume_create_manager' (f938a2ec-bc5c-436c-8120-e73219dff541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b93cb9aa-675a-4b8f-ae30-532709a2eb91 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Created volume successfully. Sep 21 16:46:27 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f 1073741824" returned: 0 in 0.570s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:27 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f Sep 21 16:46:27 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:27 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f" returned: 0 in 0.264s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.223s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-153284560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadaa593-2f01-4297-86bb-07fd753ce16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4b754523434558a83b3ce93211c50b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:17Z,use_quota=True,user_id='4f92ef22c9fd48ca97f220f599408a56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Creating volume dadaa593-2f01-4297-86bb-07fd753ce16f {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:27 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dadaa593-2f01-4297-86bb-07fd753ce16f 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb22874-3579-4031-b25d-15ba1021d460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:27 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dadaa593-2f01-4297-86bb-07fd753ce16f 1073741824 Sep 21 16:46:27 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2f0465-4196-4366-b4be-ffb8b24ac635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:27 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Volume volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f (fe64435e-e7c5-49a1-ac9b-b5463d077d7f): created successfully Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa2f0465-4196-4366-b4be-ffb8b24ac635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Flow 'volume_create_manager' (813eb54c-cf86-4a01-ac83-2b22fce26d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:27 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-389e31d8-63a8-4551-bdfa-5fb1785d4ace tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Created volume successfully. Sep 21 16:46:27 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dadaa593-2f01-4297-86bb-07fd753ce16f 1073741824" returned: 0 in 0.462s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dadaa593-2f01-4297-86bb-07fd753ce16f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:27 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dadaa593-2f01-4297-86bb-07fd753ce16f Sep 21 16:46:27 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:28 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dadaa593-2f01-4297-86bb-07fd753ce16f" returned: 0 in 0.297s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "cinder-fe64435e-e7c5-49a1-ac9b-b5463d077d7f-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f681bb-76b2-40e7-a6c3-7900a4ddd7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dadaa593-2f01-4297-86bb-07fd753ce16f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e5e533-f553-4485-a15c-e5b15742e829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-fe64435e-e7c5-49a1-ac9b-b5463d077d7f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:28 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Volume volume-dadaa593-2f01-4297-86bb-07fd753ce16f (dadaa593-2f01-4297-86bb-07fd753ce16f): created successfully Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e5e533-f553-4485-a15c-e5b15742e829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Flow 'volume_create_manager' (9381a24a-f5d0-4334-bafe-eb53afc40ff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "cinder-quobyte-fe64435e-e7c5-49a1-ac9b-b5463d077d7f" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:28 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-52bfee23-13f3-4795-b8f0-468e3475a61b tempest-VolumesTransfersV357Test-2147047254 None] Created volume successfully. Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-quobyte-fe64435e-e7c5-49a1-ac9b-b5463d077d7f" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8beaaa22-f8ac-48ea-acef-c45c6d71c676]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:28 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f Sep 21 16:46:28 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:28 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f" returned: 0 in 0.390s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:28 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f Sep 21 16:46:28 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Acquiring lock "cinder-dadaa593-2f01-4297-86bb-07fd753ce16f-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Lock "cinder-dadaa593-2f01-4297-86bb-07fd753ce16f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:29 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe64435e-e7c5-49a1-ac9b-b5463d077d7f" returned: 0 in 0.316s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-quobyte-fe64435e-e7c5-49a1-ac9b-b5463d077d7f" released by "delete_volume" :: held 0.754s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Acquiring lock "cinder-quobyte-dadaa593-2f01-4297-86bb-07fd753ce16f" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Lock "cinder-quobyte-dadaa593-2f01-4297-86bb-07fd753ce16f" acquired by "delete_volume" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0b48fd-17c5-45eb-b2f0-dec69b675490]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dadaa593-2f01-4297-86bb-07fd753ce16f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Created reservations ['65f59528-1bd6-4104-95ae-479acceb6b54', '8ed86e91-7bfe-4bd8-b667-a8b300056e14', 'de45063d-7f4d-4e11-8346-cb856171f1d2', 'b1605c96-040d-428d-b497-b7efb10f2692'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:29 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dadaa593-2f01-4297-86bb-07fd753ce16f Sep 21 16:46:29 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:29 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:29 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "cinder-8671c847-b971-422b-892f-8465725c8f89-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-8671c847-b971-422b-892f-8465725c8f89-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "cinder-quobyte-8671c847-b971-422b-892f-8465725c8f89" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:29 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.277s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-quobyte-8671c847-b971-422b-892f-8465725c8f89" acquired by "delete_volume" :: waited 0.029s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:29 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Deleted volume successfully. Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd0c150-faa0-46b6-958b-c0e70d557412]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8671c847-b971-422b-892f-8465725c8f89 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d5ca1054-31ba-44ff-9e05-4f5ebc973f1b tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-fe64435e-e7c5-49a1-ac9b-b5463d077d7f-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:29 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dadaa593-2f01-4297-86bb-07fd753ce16f" returned: 0 in 0.436s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dadaa593-2f01-4297-86bb-07fd753ce16f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:29 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dadaa593-2f01-4297-86bb-07fd753ce16f Sep 21 16:46:29 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:29 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8671c847-b971-422b-892f-8465725c8f89 Sep 21 16:46:29 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:29 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-dadaa593-2f01-4297-86bb-07fd753ce16f" returned: 0 in 0.302s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Lock "cinder-quobyte-dadaa593-2f01-4297-86bb-07fd753ce16f" released by "delete_volume" :: held 0.796s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Created reservations ['b41e7b44-19ea-4e7e-85b1-dd36bdc33669', '44551914-88b6-423d-a063-ed9f7161d61a', '8d5b62ef-ad28-491d-8e88-5d5f46ef4c80', '7a57288f-200d-43fa-8af3-61eba75c9c06'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:30 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8671c847-b971-422b-892f-8465725c8f89" returned: 0 in 0.480s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8671c847-b971-422b-892f-8465725c8f89 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:30 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8671c847-b971-422b-892f-8465725c8f89 Sep 21 16:46:30 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:30 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:30 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:30 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8671c847-b971-422b-892f-8465725c8f89" returned: 0 in 0.314s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-quobyte-8671c847-b971-422b-892f-8465725c8f89" released by "delete_volume" :: held 0.862s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:30 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.359s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:30 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Deleted volume successfully. Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9d0d5fa6-c9e2-496e-9943-419854c64e6b tempest-VolumesTransfersV357Test-1926925090 None] Lock "cinder-dadaa593-2f01-4297-86bb-07fd753ce16f-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Created reservations ['7fe99713-f8ec-4f5b-b029-743b0b89309e', '991690ad-3ec2-42f5-becd-f398a7c071dd', '75770fca-91d1-454b-b418-6f517babd7c8', '7c432960-9c86-4340-aea1-c7f610d3feac'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:30 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:30 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:30 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.308s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:30 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:30 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Deleted volume successfully. Sep 21 16:46:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c301f636-e76f-4182-af41-a5e36952e63c tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-8671c847-b971-422b-892f-8465725c8f89-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "cinder-b4f60743-7389-475f-b7e5-5986ec629526-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-b4f60743-7389-475f-b7e5-5986ec629526-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "cinder-quobyte-b4f60743-7389-475f-b7e5-5986ec629526" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-quobyte-b4f60743-7389-475f-b7e5-5986ec629526" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:31 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec348632-a759-42a3-b8dd-5a54296fcd18]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4f60743-7389-475f-b7e5-5986ec629526 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:31 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4f60743-7389-475f-b7e5-5986ec629526 Sep 21 16:46:31 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:32 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4f60743-7389-475f-b7e5-5986ec629526" returned: 0 in 0.414s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4f60743-7389-475f-b7e5-5986ec629526 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:32 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4f60743-7389-475f-b7e5-5986ec629526 Sep 21 16:46:32 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:32 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4f60743-7389-475f-b7e5-5986ec629526" returned: 0 in 0.307s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-quobyte-b4f60743-7389-475f-b7e5-5986ec629526" released by "delete_volume" :: held 0.780s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:32 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Created reservations ['d693f8bd-0751-487f-b262-892a5c59e0f7', '7cc606f0-1061-4973-aaa3-32dccf791678', '18237533-6dd1-4406-807b-cffb12b5024e', '3d42605e-3786-488d-987e-af618b6b6a8f'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:32 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:32 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "cinder-374f2f6c-9693-47d3-9a24-e7cb2071a2b2-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-374f2f6c-9693-47d3-9a24-e7cb2071a2b2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:33 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.271s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:33 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Deleted volume successfully. Sep 21 16:46:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "cinder-quobyte-374f2f6c-9693-47d3-9a24-e7cb2071a2b2" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-77005c86-1e04-4cd0-9881-526f67125e00 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-b4f60743-7389-475f-b7e5-5986ec629526-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-quobyte-374f2f6c-9693-47d3-9a24-e7cb2071a2b2" acquired by "delete_volume" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:33 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb0d8cc-4ee5-4968-acd8-606b0a8f39b9]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:33 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2 Sep 21 16:46:33 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:33 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2" returned: 0 in 0.462s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:33 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2 Sep 21 16:46:33 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:33 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-374f2f6c-9693-47d3-9a24-e7cb2071a2b2" returned: 0 in 0.320s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-quobyte-374f2f6c-9693-47d3-9a24-e7cb2071a2b2" released by "delete_volume" :: held 0.847s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:33 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Created reservations ['8f089ea5-ec6e-463c-a1ea-dc5fc54fe2d4', '57e00599-578b-497c-90bc-9a92fa1ba237', '14ad1bd4-927e-4247-8700-bf97e225303c', 'b7011d36-5025-4f1c-ac85-dea2cb50ea1e'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:34 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:34 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "cinder-6f51223f-7f7a-4d39-9a5e-88af0128f039-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-6f51223f-7f7a-4d39-9a5e-88af0128f039-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "cinder-quobyte-6f51223f-7f7a-4d39-9a5e-88af0128f039" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-quobyte-6f51223f-7f7a-4d39-9a5e-88af0128f039" acquired by "delete_volume" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4ca7c9-0e61-42e1-91ee-5485af4b915a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6f51223f-7f7a-4d39-9a5e-88af0128f039 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:34 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.380s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:34 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Deleted volume successfully. Sep 21 16:46:34 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6f51223f-7f7a-4d39-9a5e-88af0128f039 Sep 21 16:46:34 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-429c49d8-b52e-4a75-829c-2d6fe44bce72 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-374f2f6c-9693-47d3-9a24-e7cb2071a2b2-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:34 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6f51223f-7f7a-4d39-9a5e-88af0128f039" returned: 0 in 0.454s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6f51223f-7f7a-4d39-9a5e-88af0128f039 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:34 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6f51223f-7f7a-4d39-9a5e-88af0128f039 Sep 21 16:46:34 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:35 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6f51223f-7f7a-4d39-9a5e-88af0128f039" returned: 0 in 0.299s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-quobyte-6f51223f-7f7a-4d39-9a5e-88af0128f039" released by "delete_volume" :: held 0.839s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Created reservations ['a8a9db1b-1eca-40b7-a3eb-3d2140fc4866', '3b676eb1-e238-4c24-b126-94168f8d60d7', 'fa9b2f53-1214-42b2-bc32-76ca65213c16', '29e6ef69-947a-428a-b306-7b5892199237'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Flow 'volume_create_manager' (ebbea454-42f2-40c6-b779-c9308ce82065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb883d16-2726-4606-bad3-6e0cc4ebe52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb883d16-2726-4606-bad3-6e0cc4ebe52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1853182740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052f120a-df95-49a5-af43-f01ab886491e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e7faf938614a68977c4bb3445f3245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:35Z,use_quota=True,user_id='5b7871c46fce43549ce55496070055c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6203d858-dc87-4823-b2e0-a843e094f7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6203d858-dc87-4823-b2e0-a843e094f7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f337992-12df-49d4-9511-3645171d8b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.image.glance [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Creating Keystone auth plugin from conf {{(pid=86030) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:35 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:35 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "cinder-454d1b58-27c4-49a4-8f56-5bf8d062af2e-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-454d1b58-27c4-49a4-8f56-5bf8d062af2e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "cinder-quobyte-454d1b58-27c4-49a4-8f56-5bf8d062af2e" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-quobyte-454d1b58-27c4-49a4-8f56-5bf8d062af2e" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7fe0f9-704f-4821-804e-ef3ab795e0e0]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:35 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.420s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:35 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Deleted volume successfully. Sep 21 16:46:35 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e Sep 21 16:46:35 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-78cc57f8-1ec0-4e21-af5e-6ff0a3771773 tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-6f51223f-7f7a-4d39-9a5e-88af0128f039-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f337992-12df-49d4-9511-3645171d8b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '052f120a-df95-49a5-af43-f01ab886491e', 'volume_name': 'volume-052f120a-df95-49a5-af43-f01ab886491e', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de4ff95-9c8c-4679-a2f6-bd5a80c6aae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de4ff95-9c8c-4679-a2f6-bd5a80c6aae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abf361a-e16d-4868-af19-3d571a925935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:35 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Volume 052f120a-df95-49a5-af43-f01ab886491e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-052f120a-df95-49a5-af43-f01ab886491e', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 21 16:46:35 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Trying to clone 052f120a-df95-49a5-af43-f01ab886491e from image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]). {{(pid=86030) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 16:46:36 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e" returned: 0 in 0.479s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:36 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e Sep 21 16:46:36 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 16:46:36 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Image download 20.69 MB at 20.69 MB/s Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[55244d12-b457-4068-a404-095e7a3b69c8]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:36 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-454d1b58-27c4-49a4-8f56-5bf8d062af2e" returned: 0 in 0.301s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-quobyte-454d1b58-27c4-49a4-8f56-5bf8d062af2e" released by "delete_volume" :: held 0.853s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Created reservations ['f9712f4b-fea8-4b73-bc6e-342d16f8c31e', '49db2d25-06f3-4682-bdba-553308484c6d', 'bfff56c5-3381-4026-83c4-ad1d24c14cf2', '82d85e37-01ae-4ace-b3ab-a2f2006d8bdb'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:36 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD Sep 21 16:46:36 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:36 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:36 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:36 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Temporary image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c is fetched for user 5b7871c46fce43549ce55496070055c4. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3257d61-30c4-440d-940e-e6b9212725a3]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:36 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.348s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:36 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:36 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Deleted volume successfully. Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b65ac379-db33-48ac-8780-64fd6b602cbb tempest-CreateVolumesFromSourceVolumeTest-1736236858 None] Lock "cinder-454d1b58-27c4-49a4-8f56-5bf8d062af2e-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:37 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD Sep 21 16:46:37 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:37 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1853182740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052f120a-df95-49a5-af43-f01ab886491e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e7faf938614a68977c4bb3445f3245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:35Z,use_quota=True,user_id='5b7871c46fce43549ce55496070055c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Creating volume 052f120a-df95-49a5-af43-f01ab886491e {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:37 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:37 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e 1073741824 Sep 21 16:46:37 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:37 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e 1073741824" returned: 0 in 0.497s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:37 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e Sep 21 16:46:37 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:38 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e" returned: 0 in 0.303s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Attempting download of 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}])) to volume 052f120a-df95-49a5-af43-f01ab886491e. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd334626-1811-4b96-bb53-31494aa6ca1d]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1mx8ci9q {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:38 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1mx8ci9q Sep 21 16:46:38 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (e925f371-4845-43a3-8bbc-463fa89a6be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aec9566-23f7-4473-8b0b-89509c49be11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aec9566-23f7-4473-8b0b-89509c49be11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-357441741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68dbde6-3108-45e7-9421-ee635e99c6e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1e8b9e2037ed4dd290848782d5ef27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:38Z,use_quota=True,user_id='60790d3e8c4342cb8554f729bc1fc9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15272ef-dfc9-4e0c-bc3b-49d0b150ae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15272ef-dfc9-4e0c-bc3b-49d0b150ae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e523ad-b24d-47cc-9b94-af5781279477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e523ad-b24d-47cc-9b94-af5781279477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c68dbde6-3108-45e7-9421-ee635e99c6e5', 'volume_name': 'volume-c68dbde6-3108-45e7-9421-ee635e99c6e5', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479d44b4-385e-43ed-9bf0-94fbb19b4bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479d44b4-385e-43ed-9bf0-94fbb19b4bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d0d68b-36d0-46b0-a89c-f2c8564d941c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:38 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Volume c68dbde6-3108-45e7-9421-ee635e99c6e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c68dbde6-3108-45e7-9421-ee635e99c6e5', 'volume_size': 1} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-357441741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68dbde6-3108-45e7-9421-ee635e99c6e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1e8b9e2037ed4dd290848782d5ef27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:38Z,use_quota=True,user_id='60790d3e8c4342cb8554f729bc1fc9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Creating volume c68dbde6-3108-45e7-9421-ee635e99c6e5 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:38 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c68dbde6-3108-45e7-9421-ee635e99c6e5 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:38 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c68dbde6-3108-45e7-9421-ee635e99c6e5 1073741824 Sep 21 16:46:38 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:38 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1mx8ci9q" returned: 0 in 0.350s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1mx8ci9q {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:38 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1mx8ci9q Sep 21 16:46:38 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:39 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c68dbde6-3108-45e7-9421-ee635e99c6e5 1073741824" returned: 0 in 0.515s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:39 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1mx8ci9q" returned: 1 in 0.396s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1mx8ci9q' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeb007f-c4f2-463f-9ccc-30c22297e710]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c68dbde6-3108-45e7-9421-ee635e99c6e5 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:39 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c68dbde6-3108-45e7-9421-ee635e99c6e5 Sep 21 16:46:39 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:39 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD Sep 21 16:46:39 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:39 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c68dbde6-3108-45e7-9421-ee635e99c6e5" returned: 0 in 0.299s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d0d68b-36d0-46b0-a89c-f2c8564d941c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68dbde6-3108-45e7-9421-ee635e99c6e5', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8af4eb-1f6d-4eec-afb1-8aa1db5140dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:39 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Volume volume-c68dbde6-3108-45e7-9421-ee635e99c6e5 (c68dbde6-3108-45e7-9421-ee635e99c6e5): created successfully Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8af4eb-1f6d-4eec-afb1-8aa1db5140dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (e925f371-4845-43a3-8bbc-463fa89a6be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:39 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-753a63f4-ecb0-4d4f-a42c-591a10c92e1f tempest-VolumesGetTest-12217398 None] Created volume successfully. Sep 21 16:46:39 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c was qcow2, converting to qcow2 {{(pid=86030) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 16:46:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:39 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e Sep 21 16:46:39 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Flow 'volume_create_manager' (f498810a-2060-4418-ad13-be605134c1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b692d7c-c942-41a7-997d-59fce1682715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b692d7c-c942-41a7-997d-59fce1682715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-530904592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f48c4a-52ae-470a-9621-c4cb98605dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4b73227d5e41b383c34d50490ae9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:41Z,use_quota=True,user_id='03d7b0e3320c4e71844e7877fb0d2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f88ad34-7fbd-4ec2-be71-2a76092f2dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f88ad34-7fbd-4ec2-be71-2a76092f2dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f89579-6422-4137-8836-688bf4d5a0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f89579-6422-4137-8836-688bf4d5a0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f48c4a-52ae-470a-9621-c4cb98605dda', 'volume_name': 'volume-b5f48c4a-52ae-470a-9621-c4cb98605dda', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46730d6b-e500-4035-8fcf-1df36c0d1c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46730d6b-e500-4035-8fcf-1df36c0d1c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d21faf2-5fd6-4083-92fa-cbca259a7683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:40 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Volume b5f48c4a-52ae-470a-9621-c4cb98605dda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f48c4a-52ae-470a-9621-c4cb98605dda', 'volume_size': 1} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-530904592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f48c4a-52ae-470a-9621-c4cb98605dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4b73227d5e41b383c34d50490ae9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:41Z,use_quota=True,user_id='03d7b0e3320c4e71844e7877fb0d2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Creating volume b5f48c4a-52ae-470a-9621-c4cb98605dda {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:40 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b5f48c4a-52ae-470a-9621-c4cb98605dda 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:40 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b5f48c4a-52ae-470a-9621-c4cb98605dda 1073741824 Sep 21 16:46:40 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:41 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b5f48c4a-52ae-470a-9621-c4cb98605dda 1073741824" returned: 0 in 0.530s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b5f48c4a-52ae-470a-9621-c4cb98605dda {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:41 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b5f48c4a-52ae-470a-9621-c4cb98605dda Sep 21 16:46:41 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:41 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e" returned: 0 in 2.156s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_1b8ers0ddevstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:46:41 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Converted 112.00 MB image at 51.89 MB/s Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:41 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e 1G Sep 21 16:46:41 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (c78bbf99-5f2e-4342-a1d6-eeb4d71b2113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:41 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f3bc64-5387-4809-ae3c-2810cc308920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b5f48c4a-52ae-470a-9621-c4cb98605dda" returned: 0 in 0.337s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f3bc64-5387-4809-ae3c-2810cc308920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-396975818',display_name='tempest-VolumesGetTest-Volume-286194473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909b4155-94b8-4c01-bcde-bd7847b5471e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8b9e2037ed4dd290848782d5ef27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:42Z,use_quota=True,user_id='60790d3e8c4342cb8554f729bc1fc9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970d5453-4b0b-46cf-8e92-e1770020daa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970d5453-4b0b-46cf-8e92-e1770020daa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2f11a0-805c-4405-b38f-f0c67e509f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2f11a0-805c-4405-b38f-f0c67e509f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909b4155-94b8-4c01-bcde-bd7847b5471e', 'volume_name': 'volume-909b4155-94b8-4c01-bcde-bd7847b5471e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ca1e42-d4ef-4218-8d89-2adce7c4dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ca1e42-d4ef-4218-8d89-2adce7c4dd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337b7e98-2642-4f4d-a54f-fd613e6d7fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:41 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Volume 909b4155-94b8-4c01-bcde-bd7847b5471e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909b4155-94b8-4c01-bcde-bd7847b5471e', 'volume_size': 1} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-396975818',display_name='tempest-VolumesGetTest-Volume-286194473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909b4155-94b8-4c01-bcde-bd7847b5471e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8b9e2037ed4dd290848782d5ef27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:42Z,use_quota=True,user_id='60790d3e8c4342cb8554f729bc1fc9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Creating volume 909b4155-94b8-4c01-bcde-bd7847b5471e {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:41 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-909b4155-94b8-4c01-bcde-bd7847b5471e 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d21faf2-5fd6-4083-92fa-cbca259a7683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f48c4a-52ae-470a-9621-c4cb98605dda', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:41 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-909b4155-94b8-4c01-bcde-bd7847b5471e 1073741824 Sep 21 16:46:41 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818a237a-8514-4435-915d-554b3bd4df4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:41 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Volume volume-b5f48c4a-52ae-470a-9621-c4cb98605dda (b5f48c4a-52ae-470a-9621-c4cb98605dda): created successfully Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818a237a-8514-4435-915d-554b3bd4df4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:41 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Flow 'volume_create_manager' (f498810a-2060-4418-ad13-be605134c1bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:41 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b38daa94-b421-4dbb-95e7-e8c2d80dabf0 tempest-ProjectReaderTests-1812717003 None] Created volume successfully. Sep 21 16:46:42 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e 1G" returned: 0 in 0.315s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Downloaded image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}])) to volume 052f120a-df95-49a5-af43-f01ab886491e successfully. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Temporary image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c for user 5b7871c46fce43549ce55496070055c4 is deleted. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Marking volume 052f120a-df95-49a5-af43-f01ab886491e as bootable. {{(pid=86030) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Copying metadata from image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c to 052f120a-df95-49a5-af43-f01ab886491e. {{(pid=86030) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Creating volume glance metadata for volume 052f120a-df95-49a5-af43-f01ab886491e backed by image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86030) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abf361a-e16d-4868-af19-3d571a925935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052f120a-df95-49a5-af43-f01ab886491e', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c162c02-f5b9-42dc-8eb8-3c8ffeb68285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:42 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Volume volume-052f120a-df95-49a5-af43-f01ab886491e (052f120a-df95-49a5-af43-f01ab886491e): created successfully Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c162c02-f5b9-42dc-8eb8-3c8ffeb68285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Flow 'volume_create_manager' (ebbea454-42f2-40c6-b779-c9308ce82065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:42 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-12108702-459b-480c-8315-c54d046fbed3 tempest-VolumesExtendTest-1494819858 None] Created volume successfully. Sep 21 16:46:42 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-909b4155-94b8-4c01-bcde-bd7847b5471e 1073741824" returned: 0 in 0.433s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-909b4155-94b8-4c01-bcde-bd7847b5471e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:42 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-909b4155-94b8-4c01-bcde-bd7847b5471e Sep 21 16:46:42 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:42 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-909b4155-94b8-4c01-bcde-bd7847b5471e" returned: 0 in 0.250s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337b7e98-2642-4f4d-a54f-fd613e6d7fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909b4155-94b8-4c01-bcde-bd7847b5471e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4137d7-98e9-44f9-af1b-b33a860b4539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:42 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Volume volume-909b4155-94b8-4c01-bcde-bd7847b5471e (909b4155-94b8-4c01-bcde-bd7847b5471e): created successfully Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4137d7-98e9-44f9-af1b-b33a860b4539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (c78bbf99-5f2e-4342-a1d6-eeb4d71b2113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:42 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-7703cebf-35c1-433c-b060-fd8ade192ee2 tempest-VolumesGetTest-12217398 None] Created volume successfully. Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4ea21700-1ae5-497f-9aae-8ecfef8c9674 tempest-VolumesExtendTest-1494819858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4ea21700-1ae5-497f-9aae-8ecfef8c9674 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[055846c7-cf40-430d-98cd-486902c0fbd3]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4ea21700-1ae5-497f-9aae-8ecfef8c9674 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-909b4155-94b8-4c01-bcde-bd7847b5471e-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Acquiring lock "cinder-b5f48c4a-52ae-470a-9621-c4cb98605dda-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:42 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e Sep 21 16:46:42 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Lock "cinder-b5f48c4a-52ae-470a-9621-c4cb98605dda-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Lock "cinder-909b4155-94b8-4c01-bcde-bd7847b5471e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-quobyte-909b4155-94b8-4c01-bcde-bd7847b5471e" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Acquiring lock "cinder-quobyte-b5f48c4a-52ae-470a-9621-c4cb98605dda" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-909b4155-94b8-4c01-bcde-bd7847b5471e" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Lock "cinder-quobyte-b5f48c4a-52ae-470a-9621-c4cb98605dda" acquired by "delete_volume" :: waited 0.030s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd96885-2bc6-4060-9c95-31bf3a6304e2]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-909b4155-94b8-4c01-bcde-bd7847b5471e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94e7ae0-9f09-4751-86c0-eaf3071dc599]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b5f48c4a-52ae-470a-9621-c4cb98605dda {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:43 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-909b4155-94b8-4c01-bcde-bd7847b5471e Sep 21 16:46:43 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:43 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b5f48c4a-52ae-470a-9621-c4cb98605dda Sep 21 16:46:43 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:43 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4ea21700-1ae5-497f-9aae-8ecfef8c9674 tempest-VolumesExtendTest-1494819858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e" returned: 0 in 0.450s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4ea21700-1ae5-497f-9aae-8ecfef8c9674 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e 2G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4ea21700-1ae5-497f-9aae-8ecfef8c9674 tempest-VolumesExtendTest-1494819858 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e 2G" returned: 0 in 0.132s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4ea21700-1ae5-497f-9aae-8ecfef8c9674 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.618s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4ea21700-1ae5-497f-9aae-8ecfef8c9674 tempest-VolumesExtendTest-1494819858 None] Extend volume completed successfully. Sep 21 16:46:43 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-909b4155-94b8-4c01-bcde-bd7847b5471e" returned: 0 in 0.428s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-909b4155-94b8-4c01-bcde-bd7847b5471e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:43 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b5f48c4a-52ae-470a-9621-c4cb98605dda" returned: 0 in 0.426s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b5f48c4a-52ae-470a-9621-c4cb98605dda {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:43 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-909b4155-94b8-4c01-bcde-bd7847b5471e Sep 21 16:46:43 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:43 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b5f48c4a-52ae-470a-9621-c4cb98605dda Sep 21 16:46:43 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:43 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-909b4155-94b8-4c01-bcde-bd7847b5471e" returned: 0 in 0.258s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-909b4155-94b8-4c01-bcde-bd7847b5471e" released by "delete_volume" :: held 0.740s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:43 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b5f48c4a-52ae-470a-9621-c4cb98605dda" returned: 0 in 0.266s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Lock "cinder-quobyte-b5f48c4a-52ae-470a-9621-c4cb98605dda" released by "delete_volume" :: held 0.737s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Created reservations ['e88fa5f5-6cc1-4723-89de-7c34808673b2', '1b3ed6d4-2ecd-4070-bdf2-c350274b1355', '013de307-0303-43d7-beff-54ca3daaaf24', '4ce81148-9409-4ab9-a14c-04ce5570c2c4'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Created reservations ['a1d43f93-ea71-4222-8a90-bad31ede048e', '3a14c6cd-7159-4e16-9ce5-3d49c730e64d', 'c3fd2b57-9fad-4cfb-82f4-bdf563be57b7', '976bf7e2-68ff-4557-bdd1-ab2aabed1c8f'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:44 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:44 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:44 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:44 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:44 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.322s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:44 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.279s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:44 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Deleted volume successfully. Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-151d6efc-619c-4a0f-ae99-d20512e32b1c tempest-VolumesGetTest-12217398 None] Lock "cinder-909b4155-94b8-4c01-bcde-bd7847b5471e-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:44 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Deleted volume successfully. Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0339caa1-68f0-4699-9580-e2c603d8ee7c tempest-ProjectReaderTests-1812717003 None] Lock "cinder-b5f48c4a-52ae-470a-9621-c4cb98605dda-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-c68dbde6-3108-45e7-9421-ee635e99c6e5-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Lock "cinder-c68dbde6-3108-45e7-9421-ee635e99c6e5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-quobyte-c68dbde6-3108-45e7-9421-ee635e99c6e5" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-c68dbde6-3108-45e7-9421-ee635e99c6e5" acquired by "delete_volume" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Acquiring lock "cinder-052f120a-df95-49a5-af43-f01ab886491e-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b152627-f5d0-43d7-a289-bfe1710d479b]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c68dbde6-3108-45e7-9421-ee635e99c6e5 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Lock "cinder-052f120a-df95-49a5-af43-f01ab886491e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Acquiring lock "cinder-quobyte-052f120a-df95-49a5-af43-f01ab886491e" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Lock "cinder-quobyte-052f120a-df95-49a5-af43-f01ab886491e" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b9a342-4a69-41d1-9fab-a2f071fc003f]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:44 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c68dbde6-3108-45e7-9421-ee635e99c6e5 Sep 21 16:46:44 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Flow 'volume_create_manager' (20a49b5a-e67b-49ba-be2a-7a5e81ad6af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce41f53-15f3-47d0-b1ca-4d117d5a3700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce41f53-15f3-47d0-b1ca-4d117d5a3700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-982380392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d8c816-a804-458a-ae62-cb05a58431cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4b73227d5e41b383c34d50490ae9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:45Z,use_quota=True,user_id='03d7b0e3320c4e71844e7877fb0d2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df48c65-764a-4754-a31a-649533c2ef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df48c65-764a-4754-a31a-649533c2ef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8473ef41-456d-4492-ba85-0b2f24e27321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8473ef41-456d-4492-ba85-0b2f24e27321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d8c816-a804-458a-ae62-cb05a58431cb', 'volume_name': 'volume-f1d8c816-a804-458a-ae62-cb05a58431cb', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6529c6eb-8a1a-4872-9c82-1b8b855fa847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6529c6eb-8a1a-4872-9c82-1b8b855fa847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57168a5c-7f6d-47d4-9a84-29a65df98309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:44 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e Sep 21 16:46:44 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Volume f1d8c816-a804-458a-ae62-cb05a58431cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d8c816-a804-458a-ae62-cb05a58431cb', 'volume_size': 1} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-982380392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d8c816-a804-458a-ae62-cb05a58431cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4b73227d5e41b383c34d50490ae9a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:45Z,use_quota=True,user_id='03d7b0e3320c4e71844e7877fb0d2dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Creating volume f1d8c816-a804-458a-ae62-cb05a58431cb {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:44 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:44 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f1d8c816-a804-458a-ae62-cb05a58431cb 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:44 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f1d8c816-a804-458a-ae62-cb05a58431cb 1073741824 Sep 21 16:46:44 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:44 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c68dbde6-3108-45e7-9421-ee635e99c6e5" returned: 0 in 0.432s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c68dbde6-3108-45e7-9421-ee635e99c6e5 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:45 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c68dbde6-3108-45e7-9421-ee635e99c6e5 Sep 21 16:46:45 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:45 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e" returned: 0 in 0.403s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:45 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e Sep 21 16:46:45 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:45 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c68dbde6-3108-45e7-9421-ee635e99c6e5" returned: 0 in 0.286s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-c68dbde6-3108-45e7-9421-ee635e99c6e5" released by "delete_volume" :: held 0.801s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:45 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f1d8c816-a804-458a-ae62-cb05a58431cb 1073741824" returned: 0 in 0.498s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Created reservations ['eb7d02fc-e476-4ec9-8c9c-43b75e64d8f9', '3099f65f-b4ae-48d5-874e-6499ad1947c4', '02ea0f5d-e808-4034-9506-eba069b181fe', 'ec633822-2a79-4767-bcce-a9e347286724'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f1d8c816-a804-458a-ae62-cb05a58431cb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:45 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-052f120a-df95-49a5-af43-f01ab886491e" returned: 0 in 0.294s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:45 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f1d8c816-a804-458a-ae62-cb05a58431cb Sep 21 16:46:45 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Lock "cinder-quobyte-052f120a-df95-49a5-af43-f01ab886491e" released by "delete_volume" :: held 0.748s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:45 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:45 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Created reservations ['07a3c4a8-809f-4960-996c-5a5020ec265d', 'd067b903-5de8-4155-99bc-85b055048d4a', '63b6e744-2ba0-4f83-a06a-559f01301348', '2bdd1bed-d3c8-44f8-92ce-0ee440bbf7ab'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:45 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:45 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:45 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f1d8c816-a804-458a-ae62-cb05a58431cb" returned: 0 in 0.358s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57168a5c-7f6d-47d4-9a84-29a65df98309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d8c816-a804-458a-ae62-cb05a58431cb', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0d8b11-cc16-4218-b095-74d545fc7665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:45 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:45 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Volume volume-f1d8c816-a804-458a-ae62-cb05a58431cb (f1d8c816-a804-458a-ae62-cb05a58431cb): created successfully Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0d8b11-cc16-4218-b095-74d545fc7665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Flow 'volume_create_manager' (20a49b5a-e67b-49ba-be2a-7a5e81ad6af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.369s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:45 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Deleted volume successfully. Sep 21 16:46:45 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-46424083-b4df-4982-bc02-a48f7b563d3b tempest-ProjectReaderTests-1812717003 None] Created volume successfully. Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07e9d6b1-b197-4e95-aa4d-580e00ea9531 tempest-VolumesGetTest-12217398 None] Lock "cinder-c68dbde6-3108-45e7-9421-ee635e99c6e5-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:45 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.320s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:45 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Deleted volume successfully. Sep 21 16:46:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dbd47b74-8a99-41ec-92c4-8724b4209a3d tempest-VolumesExtendTest-1494819858 None] Lock "cinder-052f120a-df95-49a5-af43-f01ab886491e-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (8cd0d457-76b4-41df-9e07-0752ae76d972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e356047-2f69-4b60-b197-84e6c2a72697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e356047-2f69-4b60-b197-84e6c2a72697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1910048172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d9405e-eda8-4817-80cd-86b7b0e37920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8b9e2037ed4dd290848782d5ef27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:46Z,use_quota=True,user_id='60790d3e8c4342cb8554f729bc1fc9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fc1c19-3ed9-495c-b152-ec946bf36989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fc1c19-3ed9-495c-b152-ec946bf36989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8395a38-c433-4afc-ab10-cce7fc1e0470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8395a38-c433-4afc-ab10-cce7fc1e0470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d9405e-eda8-4817-80cd-86b7b0e37920', 'volume_name': 'volume-87d9405e-eda8-4817-80cd-86b7b0e37920', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e03b753-1b35-427d-bea0-a056fd891e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e03b753-1b35-427d-bea0-a056fd891e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9044c66-1e49-4b8a-a8fb-9a8f3387b829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:46 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Volume 87d9405e-eda8-4817-80cd-86b7b0e37920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d9405e-eda8-4817-80cd-86b7b0e37920', 'volume_size': 1} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1910048172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d9405e-eda8-4817-80cd-86b7b0e37920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8b9e2037ed4dd290848782d5ef27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:46Z,use_quota=True,user_id='60790d3e8c4342cb8554f729bc1fc9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Creating volume 87d9405e-eda8-4817-80cd-86b7b0e37920 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:46 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:46 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 1073741824 Sep 21 16:46:46 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Flow 'volume_create_manager' (1e386c94-dae8-4436-b561-34ac34fe5f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33fa4e5e-22c0-4549-b288-71ab06611fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33fa4e5e-22c0-4549-b288-71ab06611fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-67509705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92361f1-e84a-44ab-aa0d-99f4e4b6105d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e7faf938614a68977c4bb3445f3245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:47Z,use_quota=True,user_id='5b7871c46fce43549ce55496070055c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e634ba16-d91a-4a65-ab73-ef95475f392d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e634ba16-d91a-4a65-ab73-ef95475f392d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168a6066-cf78-4b48-b852-b5b3f9e580c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168a6066-cf78-4b48-b852-b5b3f9e580c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f92361f1-e84a-44ab-aa0d-99f4e4b6105d', 'volume_name': 'volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e829d7-96e5-456f-b3ed-f6c7b170116f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e829d7-96e5-456f-b3ed-f6c7b170116f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ad683b-5b14-47e5-a5d1-1f55d0a9dd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:46 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Volume f92361f1-e84a-44ab-aa0d-99f4e4b6105d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d', 'volume_size': 1} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Acquiring lock "cinder-f1d8c816-a804-458a-ae62-cb05a58431cb-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Lock "cinder-f1d8c816-a804-458a-ae62-cb05a58431cb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Acquiring lock "cinder-quobyte-f1d8c816-a804-458a-ae62-cb05a58431cb" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Lock "cinder-quobyte-f1d8c816-a804-458a-ae62-cb05a58431cb" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a01bc3f-e567-434b-ad0d-0e16d83a7a64]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f1d8c816-a804-458a-ae62-cb05a58431cb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:47 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 1073741824" returned: 0 in 0.477s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:47 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f1d8c816-a804-458a-ae62-cb05a58431cb Sep 21 16:46:47 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:47 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 Sep 21 16:46:47 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:47 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f1d8c816-a804-458a-ae62-cb05a58431cb" returned: 0 in 0.392s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f1d8c816-a804-458a-ae62-cb05a58431cb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:47 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920" returned: 0 in 0.277s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.694s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-67509705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92361f1-e84a-44ab-aa0d-99f4e4b6105d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e7faf938614a68977c4bb3445f3245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:47Z,use_quota=True,user_id='5b7871c46fce43549ce55496070055c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Creating volume f92361f1-e84a-44ab-aa0d-99f4e4b6105d {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:47 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f1d8c816-a804-458a-ae62-cb05a58431cb Sep 21 16:46:47 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:46:47 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9044c66-1e49-4b8a-a8fb-9a8f3387b829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d9405e-eda8-4817-80cd-86b7b0e37920', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:47 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d 1073741824 Sep 21 16:46:47 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c30dfc-748a-48b3-95b0-925fffb68266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:47 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Volume volume-87d9405e-eda8-4817-80cd-86b7b0e37920 (87d9405e-eda8-4817-80cd-86b7b0e37920): created successfully Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c30dfc-748a-48b3-95b0-925fffb68266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (8cd0d457-76b4-41df-9e07-0752ae76d972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:47 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4bf6172f-96db-4739-9900-e8803fd5a4b8 tempest-VolumesGetTest-12217398 None] Created volume successfully. Sep 21 16:46:47 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f1d8c816-a804-458a-ae62-cb05a58431cb" returned: 0 in 0.269s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Lock "cinder-quobyte-f1d8c816-a804-458a-ae62-cb05a58431cb" released by "delete_volume" :: held 0.706s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Created reservations ['1831046f-5b7a-4197-b65b-a00480caf3e5', '634058f7-3496-4fd3-8fdc-09fb0d30d7e7', '120b1338-6037-4169-8f0e-d2042e386ab8', 'ea43be96-1408-48da-b141-b21194e54bb1'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:47 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:46:47 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:47 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d 1073741824" returned: 0 in 0.448s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:47 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d Sep 21 16:46:47 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:48 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.279s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:46:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Deleted volume successfully. Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b60c89ba-34b6-48ee-bd5a-a5e83b6e7182 tempest-ProjectReaderTests-1812717003 None] Lock "cinder-f1d8c816-a804-458a-ae62-cb05a58431cb-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:46:48 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d" returned: 0 in 0.286s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ad683b-5b14-47e5-a5d1-1f55d0a9dd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30f6542-748f-41e5-be1a-29b7729c0c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:48 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Volume volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d (f92361f1-e84a-44ab-aa0d-99f4e4b6105d): created successfully Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30f6542-748f-41e5-be1a-29b7729c0c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Flow 'volume_create_manager' (1e386c94-dae8-4436-b561-34ac34fe5f73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-bbf8e46e-e043-4374-b1d4-7c0012eaa896 tempest-VolumesExtendTest-1494819858 None] Created volume successfully. Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] Creating offline snapshot 56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 of volume f92361f1-e84a-44ab-aa0d-99f4e4b6105d {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f3c6f2-9afb-4afd-aa97-17abae8596d9]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:48 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d Sep 21 16:46:48 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (2cb34dd4-3176-40a1-8f48-a3f37dbeb826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ecd3dd-2cf7-41c3-9f2d-c9a8889caffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ecd3dd-2cf7-41c3-9f2d-c9a8889caffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1253502023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c869c0-a3cb-4802-9b88-472ea5f4f400,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1e8b9e2037ed4dd290848782d5ef27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=87d9405e-eda8-4817-80cd-86b7b0e37920,status='creating',terminated_at=None,updated_at=2026-09-21T14:46:49Z,use_quota=True,user_id='60790d3e8c4342cb8554f729bc1fc9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc5439b-ae1d-41b8-bc12-0f3052bbb542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cc5439b-ae1d-41b8-bc12-0f3052bbb542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce76d55-f6a5-4db0-b460-8e8add4fa6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce76d55-f6a5-4db0-b460-8e8add4fa6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '56c869c0-a3cb-4802-9b88-472ea5f4f400', 'volume_name': 'volume-56c869c0-a3cb-4802-9b88-472ea5f4f400', 'volume_size': 1, 'source_volid': '87d9405e-eda8-4817-80cd-86b7b0e37920', 'source_volstatus': 'available'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dc3dfe-84d4-4de0-b8f6-ed1db51d506f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dc3dfe-84d4-4de0-b8f6-ed1db51d506f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:46:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14f0a36-63e7-4bbd-be40-512feb039875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:46:48 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Volume 56c869c0-a3cb-4802-9b88-472ea5f4f400: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-56c869c0-a3cb-4802-9b88-472ea5f4f400', 'volume_size': 1, 'source_volid': '87d9405e-eda8-4817-80cd-86b7b0e37920', 'source_volstatus': 'available'} Sep 21 16:46:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:49 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d" returned: 0 in 0.401s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:49 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 1G Sep 21 16:46:49 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:49 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 1G" returned: 0 in 0.457s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:49 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 Sep 21 16:46:49 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:49 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8" returned: 0 in 0.324s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:49 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 is being set with open permissions: ugo+rw Sep 21 16:46:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:49 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 Sep 21 16:46:49 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:50 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8" returned: 0 in 0.253s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:50 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.info Sep 21 16:46:50 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:50 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.info" returned: 0 in 0.264s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:50 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.info is being set with open permissions: ugo+rw Sep 21 16:46:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:50 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.info Sep 21 16:46:50 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:50 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.info" returned: 0 in 0.246s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.647s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:50 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Cloning volume 87d9405e-eda8-4817-80cd-86b7b0e37920 to volume 56c869c0-a3cb-4802-9b88-472ea5f4f400 Sep 21 16:46:50 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-240d0133-50db-458c-b291-8accd1cfb9c9 tempest-VolumesExtendTest-1494819858 None] Create snapshot completed successfully Sep 21 16:46:50 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Creating offline snapshot 3db92939-d168-409d-8fb5-0b1ac7bb339c of volume 87d9405e-eda8-4817-80cd-86b7b0e37920 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:46:50 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb9d4cf-f1fd-4459-b043-992f6ed87fc3]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:50 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 Sep 21 16:46:50 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:51 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920" returned: 0 in 0.373s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:51 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c 1G Sep 21 16:46:51 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:51 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c 1G" returned: 0 in 0.442s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87d9405e-eda8-4817-80cd-86b7b0e37920 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:51 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87d9405e-eda8-4817-80cd-86b7b0e37920 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c Sep 21 16:46:51 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-062c6cb9-0bf3-40e0-ac82-6c6cd386327e tempest-VolumesExtendTest-1494819858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:51 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87d9405e-eda8-4817-80cd-86b7b0e37920 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c" returned: 0 in 0.348s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:51 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c is being set with open permissions: ugo+rw Sep 21 16:46:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:51 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c Sep 21 16:46:51 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:52 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c" returned: 0 in 0.280s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:52 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.info Sep 21 16:46:52 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:52 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.info" returned: 0 in 0.274s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:52 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.info is being set with open permissions: ugo+rw Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:52 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.info Sep 21 16:46:52 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:52 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.info" returned: 0 in 0.254s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-quobyte-56c869c0-a3cb-4802-9b88-472ea5f4f400" by "_copy_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-56c869c0-a3cb-4802-9b88-472ea5f4f400" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] snapshot: 3db92939-d168-409d-8fb5-0b1ac7bb339c, volume: 56c869c0-a3cb-4802-9b88-472ea5f4f400, {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecaaa9d-51ba-4b64-8336-9813af229d79]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:52 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c Sep 21 16:46:52 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:53 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c" returned: 0 in 0.372s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87d9405e-eda8-4817-80cd-86b7b0e37920(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:46:53 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e927a38-b659-4900-84e0-d8bba7458c5c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:46:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:53 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 Sep 21 16:46:53 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:46:53 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 21 16:46:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920" returned: 0 in 0.428s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:46:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 16:46:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Creating direct copy from snapshot {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 16:46:53 devstack cinder-volume[86030]: DEBUG cinder.utils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Path /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400 not found in is_blk_device check {{(pid=86030) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 21 16:46:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:46:53 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400 Sep 21 16:46:53 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:00 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400" returned: 0 in 6.915s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:00 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400 {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:47:00 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Converted 1024.00 MB image at 148.05 MB/s Sep 21 16:47:00 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400 is being set with open permissions: ugo+rw Sep 21 16:47:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:00 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400 Sep 21 16:47:00 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:00 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400" returned: 0 in 0.276s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-56c869c0-a3cb-4802-9b88-472ea5f4f400" released by "_copy_volume_from_snapshot" :: held 8.076s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-quobyte-3db92939-d168-409d-8fb5-0b1ac7bb339c" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:00 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-3db92939-d168-409d-8fb5-0b1ac7bb339c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Deleting offline snapshot 3db92939-d168-409d-8fb5-0b1ac7bb339c of volume 87d9405e-eda8-4817-80cd-86b7b0e37920 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:47:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] snapshot_file for this snap is: volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:47:00 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[512737ec-40ad-41d6-b3d8-a5829396fcb4]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:01 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c Sep 21 16:47:01 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:01 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c" returned: 0 in 0.406s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87d9405e-eda8-4817-80cd-86b7b0e37920(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:47:01 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[e416a7d1-7853-4752-91aa-355c8641ce59]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:01 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 Sep 21 16:47:01 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:01 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920" returned: 0 in 0.572s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:01 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c Sep 21 16:47:01 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:02 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=158,cinder:SELECT=115,cinder:INSERT=37,cinder:DELETE=9 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:47:02 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c" returned: 0 in 0.338s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:02 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c Sep 21 16:47:02 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:02 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920.3db92939-d168-409d-8fb5-0b1ac7bb339c" returned: 0 in 0.274s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-3db92939-d168-409d-8fb5-0b1ac7bb339c" released by "_delete_snapshot" :: held 1.707s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.970s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-062c6cb9-0bf3-40e0-ac82-6c6cd386327e tempest-VolumesExtendTest-1494819858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 10.744s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14f0a36-63e7-4bbd-be40-512feb039875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c869c0-a3cb-4802-9b88-472ea5f4f400', 'volume_size': 1, 'source_volid': '87d9405e-eda8-4817-80cd-86b7b0e37920', 'source_volstatus': 'available'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b8d7d8-31fa-4843-abee-34cdcf9119fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:02 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad7e150-1582-4cce-8edf-972bf55a1200]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-062c6cb9-0bf3-40e0-ac82-6c6cd386327e tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:02 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Volume volume-56c869c0-a3cb-4802-9b88-472ea5f4f400 (56c869c0-a3cb-4802-9b88-472ea5f4f400): created successfully Sep 21 16:47:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b8d7d8-31fa-4843-abee-34cdcf9119fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (2cb34dd4-3176-40a1-8f48-a3f37dbeb826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:02 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-445f50ae-6676-4524-aa5f-9ca41c8f280f tempest-VolumesGetTest-12217398 None] Created volume successfully. Sep 21 16:47:02 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d Sep 21 16:47:02 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:03 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-062c6cb9-0bf3-40e0-ac82-6c6cd386327e tempest-VolumesExtendTest-1494819858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d" returned: 0 in 0.376s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-062c6cb9-0bf3-40e0-ac82-6c6cd386327e tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 2G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-062c6cb9-0bf3-40e0-ac82-6c6cd386327e tempest-VolumesExtendTest-1494819858 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 2G" returned: 0 in 0.135s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-062c6cb9-0bf3-40e0-ac82-6c6cd386327e tempest-VolumesExtendTest-1494819858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.560s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-062c6cb9-0bf3-40e0-ac82-6c6cd386327e tempest-VolumesExtendTest-1494819858 None] Extend volume completed successfully. Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (ae5fa171-b81e-47d6-8a7a-8998ab829f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1b04c8-96f0-493a-8979-a9a3776ec721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1b04c8-96f0-493a-8979-a9a3776ec721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1143711455',display_name='tempest-VolumesGetTest-Volume-1459935446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8b9e2037ed4dd290848782d5ef27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:04Z,use_quota=True,user_id='60790d3e8c4342cb8554f729bc1fc9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006b37ed-8528-4b59-8378-df93f1ec4e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006b37ed-8528-4b59-8378-df93f1ec4e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37a4d3f-a044-457f-9dbb-7b2305c6ea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37a4d3f-a044-457f-9dbb-7b2305c6ea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3', 'volume_name': 'volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62d3ac3-86d7-475e-89d7-a4394d035f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62d3ac3-86d7-475e-89d7-a4394d035f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05685e9-c96d-4523-9d1e-e813fe679bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:03 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Volume a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3', 'volume_size': 1} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1143711455',display_name='tempest-VolumesGetTest-Volume-1459935446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8b9e2037ed4dd290848782d5ef27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:04Z,use_quota=True,user_id='60790d3e8c4342cb8554f729bc1fc9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Creating volume a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:47:03 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:47:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:03 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3 1073741824 Sep 21 16:47:03 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Acquiring lock "cinder-56fd9da7-94f9-4ee2-b9a4-386cd72bffd8-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Lock "cinder-56fd9da7-94f9-4ee2-b9a4-386cd72bffd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Acquiring lock "cinder-quobyte-f92361f1-e84a-44ab-aa0d-99f4e4b6105d" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Lock "cinder-quobyte-f92361f1-e84a-44ab-aa0d-99f4e4b6105d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Acquiring lock "cinder-quobyte-56fd9da7-94f9-4ee2-b9a4-386cd72bffd8" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Lock "cinder-quobyte-56fd9da7-94f9-4ee2-b9a4-386cd72bffd8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Deleting offline snapshot 56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 of volume f92361f1-e84a-44ab-aa0d-99f4e4b6105d {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] snapshot_file for this snap is: volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[d695d5d5-625d-49ed-b563-86ddac637395]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:04 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 Sep 21 16:47:04 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:04 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3 1073741824" returned: 0 in 0.481s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=126,cinder:UPDATE=178,cinder:INSERT=50,cinder:DELETE=22 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:04 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3 Sep 21 16:47:04 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:04 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8" returned: 0 in 0.402s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47dae98-1a4d-4e6e-9641-91137a30c9c9]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:04 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3" returned: 0 in 0.253s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05685e9-c96d-4523-9d1e-e813fe679bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dc41ff-4689-4a4a-9bde-14162a8890ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:04 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Volume volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3 (a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3): created successfully Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dc41ff-4689-4a4a-9bde-14162a8890ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (ae5fa171-b81e-47d6-8a7a-8998ab829f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:04 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-bef73f5b-6b1d-46b0-8b86-deaf6da803e1 tempest-VolumesGetTest-12217398 None] Created volume successfully. Sep 21 16:47:04 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d Sep 21 16:47:04 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:04 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d" returned: 0 in 0.368s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:05 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 Sep 21 16:47:05 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:05 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8" returned: 0 in 0.366s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:05 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8 Sep 21 16:47:05 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:05 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d.56fd9da7-94f9-4ee2-b9a4-386cd72bffd8" returned: 0 in 0.245s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:05 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Lock "cinder-quobyte-56fd9da7-94f9-4ee2-b9a4-386cd72bffd8" released by "_delete_snapshot" :: held 1.492s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:05 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Lock "cinder-quobyte-f92361f1-e84a-44ab-aa0d-99f4e4b6105d" released by "delete_snapshot" :: held 1.518s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:05 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Created reservations ['cfd78260-7255-4c9a-9b06-9fec654b3432', 'db4fb065-4187-492d-90e5-5c47fee2e194', 'fffa9082-4f6a-4542-823f-6250e0122bc7', '9e8c6a4f-3435-4104-8c50-c5ab60121259'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:05 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Delete snapshot completed successfully. Sep 21 16:47:05 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-830dd1fe-fc38-477e-93ec-836fa12b266c tempest-VolumesExtendTest-1494819858 None] Lock "cinder-56fd9da7-94f9-4ee2-b9a4-386cd72bffd8-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:05 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Lock "cinder-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-quobyte-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3" acquired by "delete_volume" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1894aff-9f6f-4050-9044-c45d62c7db59]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:06 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3 Sep 21 16:47:06 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Acquiring lock "cinder-f92361f1-e84a-44ab-aa0d-99f4e4b6105d-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Lock "cinder-f92361f1-e84a-44ab-aa0d-99f4e4b6105d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Acquiring lock "cinder-quobyte-f92361f1-e84a-44ab-aa0d-99f4e4b6105d" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Lock "cinder-quobyte-f92361f1-e84a-44ab-aa0d-99f4e4b6105d" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba44559-a842-48b9-94fa-750fb90feb89]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:06 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3" returned: 0 in 0.386s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:06 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3 Sep 21 16:47:06 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:06 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d Sep 21 16:47:06 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:06 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3" returned: 0 in 0.252s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3" released by "delete_volume" :: held 0.682s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Created reservations ['fae1b298-3219-45e3-968f-2f12e85e14a6', 'b7aad905-b8b9-4634-a7a8-04c82fcffc8b', 'b0b207c6-a1e3-4e70-b5ad-cfc69524f0be', '2d5620d4-dc58-43f4-ab9b-78df9f6e5d0c'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:06 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d" returned: 0 in 0.417s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:06 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:47:06 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:06 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d Sep 21 16:47:06 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:07 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.260s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:47:07 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Deleted volume successfully. Sep 21 16:47:07 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-14f11028-a0bf-44bb-9b14-3d1d79c56438 tempest-VolumesGetTest-12217398 None] Lock "cinder-a8f79f4f-a546-4c1e-a0a5-24f3aaedc6d3-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f92361f1-e84a-44ab-aa0d-99f4e4b6105d" returned: 0 in 0.284s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Lock "cinder-quobyte-f92361f1-e84a-44ab-aa0d-99f4e4b6105d" released by "delete_volume" :: held 0.768s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Created reservations ['d1631410-65ea-4c7e-a57c-71bdea132100', '1f1d599c-72d6-4f89-8b80-031caa5f6c36', 'cb9274ec-ed11-45fa-a588-cb63f62ee805', '0cf8bb19-8578-4466-9691-3e5fe0cc01b7'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-56c869c0-a3cb-4802-9b88-472ea5f4f400-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Lock "cinder-56c869c0-a3cb-4802-9b88-472ea5f4f400-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-quobyte-56c869c0-a3cb-4802-9b88-472ea5f4f400" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:07 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:47:07 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-56c869c0-a3cb-4802-9b88-472ea5f4f400" acquired by "delete_volume" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7d45d1-e907-41bf-ad67-1f3b5b9e3828]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:07 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400 Sep 21 16:47:07 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:07 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.269s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:47:07 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Deleted volume successfully. Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3a88f674-cf2f-4e77-b548-ed8887929320 tempest-VolumesExtendTest-1494819858 None] Lock "cinder-f92361f1-e84a-44ab-aa0d-99f4e4b6105d-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:07 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400" returned: 0 in 0.401s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:07 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400 Sep 21 16:47:07 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:07 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:47:07 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:08 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-56c869c0-a3cb-4802-9b88-472ea5f4f400" returned: 0 in 0.268s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-56c869c0-a3cb-4802-9b88-472ea5f4f400" released by "delete_volume" :: held 0.714s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Created reservations ['a63b5849-c9f6-4ebc-b79c-76cb32b89f7f', '00035bac-6057-4226-97f8-9d506f52495b', 'ce16ade2-cbe6-413c-9022-c4743a422ccb', '1467c6ec-5dbc-4ec6-abe2-cc7d279bee15'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:08 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.285s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 29 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:08 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:47:08 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:08 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-87d9405e-eda8-4817-80cd-86b7b0e37920-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.299s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:47:08 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Deleted volume successfully. Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Lock "cinder-87d9405e-eda8-4817-80cd-86b7b0e37920-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-98e83c04-df0b-44f6-a78d-a5737020636b tempest-VolumesGetTest-12217398 None] Lock "cinder-56c869c0-a3cb-4802-9b88-472ea5f4f400-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-quobyte-87d9405e-eda8-4817-80cd-86b7b0e37920" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-87d9405e-eda8-4817-80cd-86b7b0e37920" acquired by "delete_volume" :: waited 0.013s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f7df18-7eb5-4c97-a18f-4784edfc28ba]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:08 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 Sep 21 16:47:08 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:09 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920" returned: 0 in 0.391s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:09 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920 Sep 21 16:47:09 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:09 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-87d9405e-eda8-4817-80cd-86b7b0e37920" returned: 0 in 0.255s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-87d9405e-eda8-4817-80cd-86b7b0e37920" released by "delete_volume" :: held 0.724s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Created reservations ['0f488b52-ca4a-47ba-8281-c79a3850609c', '71c89e22-f71a-4b32-8ec0-048015641c9e', '51c8ce3e-4f2c-42e2-a14d-e62c596e71a2', 'e5dce8e3-2be8-4e3f-bd87-ba23b940d604'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:09 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:47:09 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:09 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.404s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:47:09 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Deleted volume successfully. Sep 21 16:47:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ad9f9681-1626-4a5b-a94a-f2cb8511d24b tempest-VolumesGetTest-12217398 None] Lock "cinder-87d9405e-eda8-4817-80cd-86b7b0e37920-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:10 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:47:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (4189ad6c-0561-4c7e-bb7b-160e660f0f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe6a16a-0d07-4155-8b67-93a16cb231d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe6a16a-0d07-4155-8b67-93a16cb231d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-437342165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c53f17-f29a-4d6d-bbc9-773642030820,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1e8b9e2037ed4dd290848782d5ef27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:10Z,use_quota=True,user_id='60790d3e8c4342cb8554f729bc1fc9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7481ca4b-4c15-49cf-a3d9-9c50fdaafb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7481ca4b-4c15-49cf-a3d9-9c50fdaafb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77a2462-2ab6-4fc4-9140-a40efc3589b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:10 devstack cinder-volume[86030]: DEBUG cinder.image.glance [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Creating Keystone auth plugin from conf {{(pid=86030) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 16:47:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77a2462-2ab6-4fc4-9140-a40efc3589b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33c53f17-f29a-4d6d-bbc9-773642030820', 'volume_name': 'volume-33c53f17-f29a-4d6d-bbc9-773642030820', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39e38da-279f-41d3-bc98-4cb421fe4f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39e38da-279f-41d3-bc98-4cb421fe4f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b13c219-3cbf-4100-933b-8c44416a1bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:10 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Volume 33c53f17-f29a-4d6d-bbc9-773642030820: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33c53f17-f29a-4d6d-bbc9-773642030820', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 21 16:47:10 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Trying to clone 33c53f17-f29a-4d6d-bbc9-773642030820 from image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]). {{(pid=86030) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 16:47:11 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 16:47:11 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Image download 20.69 MB at 20.69 MB/s Sep 21 16:47:11 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e0f37a-5f9c-4b18-b799-25065e85531b]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:11 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD Sep 21 16:47:11 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:11 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:11 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Temporary image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c is fetched for user 60790d3e8c4342cb8554f729bc1fc9c6. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 16:47:11 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ab0288-7d27-421a-80f8-f671a8bd6de8]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:11 devstack sudo[100192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD Sep 21 16:47:11 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:12 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-437342165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c53f17-f29a-4d6d-bbc9-773642030820,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1e8b9e2037ed4dd290848782d5ef27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:10Z,use_quota=True,user_id='60790d3e8c4342cb8554f729bc1fc9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Creating volume 33c53f17-f29a-4d6d-bbc9-773642030820 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:47:12 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:12 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 1073741824 Sep 21 16:47:12 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:12 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 1073741824" returned: 0 in 0.505s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:12 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 Sep 21 16:47:12 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:12 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820" returned: 0 in 0.256s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:47:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:13 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Attempting download of 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}])) to volume 33c53f17-f29a-4d6d-bbc9-773642030820. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 21 16:47:13 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d237bb-3fc4-4b9f-b82a-0a8c001c6909]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_o66n8o0o {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:13 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_o66n8o0o Sep 21 16:47:13 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:13 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_o66n8o0o" returned: 0 in 0.344s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_o66n8o0o {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:13 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_o66n8o0o Sep 21 16:47:13 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:13 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_o66n8o0o" returned: 1 in 0.348s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_o66n8o0o' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:47:13 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9026d6e9-a093-4d0b-87c1-13d4ce0bec18]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:13 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD Sep 21 16:47:13 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:14 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:14 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c was qcow2, converting to qcow2 {{(pid=86030) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 16:47:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:14 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 Sep 21 16:47:14 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:16 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820" returned: 0 in 2.038s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:16 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_gfd7m__9devstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:47:16 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Converted 112.00 MB image at 54.92 MB/s Sep 21 16:47:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:16 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 1G Sep 21 16:47:16 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:16 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 1G" returned: 0 in 0.351s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:16 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Downloaded image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}])) to volume 33c53f17-f29a-4d6d-bbc9-773642030820 successfully. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 21 16:47:16 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Temporary image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c for user 60790d3e8c4342cb8554f729bc1fc9c6 is deleted. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 16:47:16 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Marking volume 33c53f17-f29a-4d6d-bbc9-773642030820 as bootable. {{(pid=86030) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 21 16:47:16 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Copying metadata from image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c to 33c53f17-f29a-4d6d-bbc9-773642030820. {{(pid=86030) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 16:47:16 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Creating volume glance metadata for volume 33c53f17-f29a-4d6d-bbc9-773642030820 backed by image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86030) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 16:47:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b13c219-3cbf-4100-933b-8c44416a1bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c53f17-f29a-4d6d-bbc9-773642030820', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df2dcc7-d2d7-4148-9f52-0c1895a7a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:16 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Volume volume-33c53f17-f29a-4d6d-bbc9-773642030820 (33c53f17-f29a-4d6d-bbc9-773642030820): created successfully Sep 21 16:47:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df2dcc7-d2d7-4148-9f52-0c1895a7a688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (4189ad6c-0561-4c7e-bb7b-160e660f0f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:16 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e748138d-be60-4f12-95ce-2eaa5157c427 tempest-VolumesGetTest-12217398 None] Created volume successfully. Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (8b283003-f923-49d2-b732-8f3b4a8bc4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54b658c-ed7f-4e5d-a8d6-2a5bb9c45945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54b658c-ed7f-4e5d-a8d6-2a5bb9c45945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2006379576',display_name='tempest-VolumesGetTest-Volume-187767007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e3c2f5-74f1-4777-9e76-8c811c1e862e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8b9e2037ed4dd290848782d5ef27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:18Z,use_quota=True,user_id='60790d3e8c4342cb8554f729bc1fc9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fb920e-ae39-465a-b363-49e233505c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fb920e-ae39-465a-b363-49e233505c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a157a717-75bd-4acb-8103-43fc12655b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a157a717-75bd-4acb-8103-43fc12655b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e3c2f5-74f1-4777-9e76-8c811c1e862e', 'volume_name': 'volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421283e9-c7de-498d-a8c3-44b9162d01b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421283e9-c7de-498d-a8c3-44b9162d01b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adaead5-9470-41c6-bde6-a623f353fe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:17 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Volume d9e3c2f5-74f1-4777-9e76-8c811c1e862e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e', 'volume_size': 1} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2006379576',display_name='tempest-VolumesGetTest-Volume-187767007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e3c2f5-74f1-4777-9e76-8c811c1e862e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8b9e2037ed4dd290848782d5ef27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:18Z,use_quota=True,user_id='60790d3e8c4342cb8554f729bc1fc9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Creating volume d9e3c2f5-74f1-4777-9e76-8c811c1e862e {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:47:17 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:47:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:17 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e 1073741824 Sep 21 16:47:17 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:18 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e 1073741824" returned: 0 in 0.559s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:18 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e Sep 21 16:47:18 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:18 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e" returned: 0 in 0.277s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:18 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:47:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adaead5-9470-41c6-bde6-a623f353fe95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0054c9c-2c8f-43a5-a6e8-fc7adf0a52ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:18 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Volume volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e (d9e3c2f5-74f1-4777-9e76-8c811c1e862e): created successfully Sep 21 16:47:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0054c9c-2c8f-43a5-a6e8-fc7adf0a52ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Flow 'volume_create_manager' (8b283003-f923-49d2-b732-8f3b4a8bc4da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:18 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3b7d0635-7aad-4559-bc98-b2b18fee567b tempest-VolumesGetTest-12217398 None] Created volume successfully. Sep 21 16:47:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-d9e3c2f5-74f1-4777-9e76-8c811c1e862e-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Lock "cinder-d9e3c2f5-74f1-4777-9e76-8c811c1e862e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-quobyte-d9e3c2f5-74f1-4777-9e76-8c811c1e862e" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-d9e3c2f5-74f1-4777-9e76-8c811c1e862e" acquired by "delete_volume" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb134e7-42f6-4b27-a029-bd9a5f9a76c1]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:20 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e Sep 21 16:47:20 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:20 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e" returned: 0 in 0.445s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:20 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e Sep 21 16:47:20 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:20 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-d9e3c2f5-74f1-4777-9e76-8c811c1e862e" returned: 0 in 0.266s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-d9e3c2f5-74f1-4777-9e76-8c811c1e862e" released by "delete_volume" :: held 0.766s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Created reservations ['bf1430cc-cc04-4a1d-ae7f-9789033883f9', '19b71a8f-07aa-4df6-bb5c-30e1f0069f86', '2ac27389-0a2f-4b5d-bbb5-1260f093d300', '035d44f1-e31a-4c1d-834b-0d118173c95a'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:20 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:47:20 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:21 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-33c53f17-f29a-4d6d-bbc9-773642030820-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.302s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:47:21 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Deleted volume successfully. Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Lock "cinder-33c53f17-f29a-4d6d-bbc9-773642030820-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6e5b7d10-4dbe-4189-9da8-47821ecc6d8a tempest-VolumesGetTest-12217398 None] Lock "cinder-d9e3c2f5-74f1-4777-9e76-8c811c1e862e-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Acquiring lock "cinder-quobyte-33c53f17-f29a-4d6d-bbc9-773642030820" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-33c53f17-f29a-4d6d-bbc9-773642030820" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4101b28-ef25-4006-9ee9-8a573a71e961]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Flow 'volume_create_manager' (d8b72170-c16e-41a0-9aaf-e9ffd2553f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09be6bd9-4a30-4ecc-acfc-66f0640ae1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09be6bd9-4a30-4ecc-acfc-66f0640ae1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-441805634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c305f6ab-9d0e-43a3-a2ee-77809aaa776a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda2abc1e58647f78c39c1da384eaf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:21Z,use_quota=True,user_id='3356e3c293224bba9ba16b7ffe54c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107c96f5-92bc-4182-ae0e-8d78f176a60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107c96f5-92bc-4182-ae0e-8d78f176a60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eafc76be-f6f2-45b9-ba1c-23d2c9a07729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eafc76be-f6f2-45b9-ba1c-23d2c9a07729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c305f6ab-9d0e-43a3-a2ee-77809aaa776a', 'volume_name': 'volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae89a2df-b946-4fd5-bcc9-6207b5ff80fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:21 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 Sep 21 16:47:21 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae89a2df-b946-4fd5-bcc9-6207b5ff80fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf82b8b-88a1-49af-9932-c1b93b5661d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:21 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Volume c305f6ab-9d0e-43a3-a2ee-77809aaa776a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a', 'volume_size': 1} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-441805634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c305f6ab-9d0e-43a3-a2ee-77809aaa776a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda2abc1e58647f78c39c1da384eaf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:21Z,use_quota=True,user_id='3356e3c293224bba9ba16b7ffe54c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Creating volume c305f6ab-9d0e-43a3-a2ee-77809aaa776a {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:47:21 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:21 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a 1073741824 Sep 21 16:47:21 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:21 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820" returned: 0 in 0.381s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:21 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820 Sep 21 16:47:21 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:21 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a 1073741824" returned: 0 in 0.459s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:22 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33c53f17-f29a-4d6d-bbc9-773642030820" returned: 0 in 0.258s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:22 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a Sep 21 16:47:22 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Lock "cinder-quobyte-33c53f17-f29a-4d6d-bbc9-773642030820" released by "delete_volume" :: held 0.689s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Created reservations ['ecab183f-bdb3-40f2-9d4e-22729a08a1c1', '41c39344-9b78-49bf-84bc-17e19d3e7d34', '20df707d-f9b0-41cf-a2e2-58282ad5af33', 'c9bba0c0-c1d7-450d-a38d-605fa0269020'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:22 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:47:22 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:22 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a" returned: 0 in 0.262s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbf82b8b-88a1-49af-9932-c1b93b5661d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26072939-d517-474a-aeed-70e168b1580b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:22 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Volume volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a (c305f6ab-9d0e-43a3-a2ee-77809aaa776a): created successfully Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26072939-d517-474a-aeed-70e168b1580b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Flow 'volume_create_manager' (d8b72170-c16e-41a0-9aaf-e9ffd2553f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:22 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a3913a58-5fc7-4b09-99b4-44dbd86fb480 tempest-VolumesSnapshotTestJSON-299513393 None] Created volume successfully. Sep 21 16:47:22 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.270s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:47:22 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Deleted volume successfully. Sep 21 16:47:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6bc005eb-7a49-40f8-8c77-d436122cf2e3 tempest-VolumesGetTest-12217398 None] Lock "cinder-33c53f17-f29a-4d6d-bbc9-773642030820-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] Creating offline snapshot 69917fe0-bb76-4e6f-8677-987e95b88e8e of volume c305f6ab-9d0e-43a3-a2ee-77809aaa776a {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:47:24 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a6f763-d5f9-4f1d-b4da-fbbe918829c2]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:24 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a Sep 21 16:47:24 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:24 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a" returned: 0 in 0.372s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:24 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e 1G Sep 21 16:47:24 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:24 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e 1G" returned: 0 in 0.419s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:24 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e Sep 21 16:47:24 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:25 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e" returned: 0 in 0.296s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:25 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e is being set with open permissions: ugo+rw Sep 21 16:47:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:25 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e Sep 21 16:47:25 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:25 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e" returned: 0 in 0.253s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:25 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.info Sep 21 16:47:25 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:25 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.info" returned: 0 in 0.269s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:25 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.info is being set with open permissions: ugo+rw Sep 21 16:47:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:25 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.info Sep 21 16:47:25 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:25 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.info" returned: 0 in 0.256s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:25 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-9698889e-2fc1-4352-95d7-f21d91492eb8 tempest-VolumesSnapshotTestJSON-299513393 None] Create snapshot completed successfully Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-69917fe0-bb76-4e6f-8677-987e95b88e8e-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-69917fe0-bb76-4e6f-8677-987e95b88e8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-c305f6ab-9d0e-43a3-a2ee-77809aaa776a" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-c305f6ab-9d0e-43a3-a2ee-77809aaa776a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-69917fe0-bb76-4e6f-8677-987e95b88e8e" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-69917fe0-bb76-4e6f-8677-987e95b88e8e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Deleting offline snapshot 69917fe0-bb76-4e6f-8677-987e95b88e8e of volume c305f6ab-9d0e-43a3-a2ee-77809aaa776a {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] snapshot_file for this snap is: volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a75fdd4-ed97-4a7b-b725-8f5904ef103e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:26 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e Sep 21 16:47:26 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:26 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e" returned: 0 in 0.412s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[894a557e-191d-4f36-b3a6-bb856db0f650]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:26 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a Sep 21 16:47:26 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:27 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a" returned: 0 in 0.361s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:27 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e Sep 21 16:47:27 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:27 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e" returned: 0 in 0.352s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:27 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e Sep 21 16:47:27 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:27 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a.69917fe0-bb76-4e6f-8677-987e95b88e8e" returned: 0 in 0.278s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-69917fe0-bb76-4e6f-8677-987e95b88e8e" released by "_delete_snapshot" :: held 1.525s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-c305f6ab-9d0e-43a3-a2ee-77809aaa776a" released by "delete_snapshot" :: held 1.556s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:27 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Created reservations ['b51757cd-7f6d-429f-88ce-6c9133120a2b', 'fd594876-12c3-4903-9dce-c75e9294b1a5', '4c5c9d12-b6da-4df6-91e5-418b22ecc50e', '446cbf30-8be5-45c0-af19-acb39ed0e72f'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:28 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Delete snapshot completed successfully. Sep 21 16:47:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fb4edfe3-e595-4468-a94e-6b3061aabae7 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-69917fe0-bb76-4e6f-8677-987e95b88e8e-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Flow 'volume_create_manager' (ff8d847d-efca-41a3-8cdd-cac04c3fab36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcf6e1b-d495-4353-877e-88bcd46dfdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcf6e1b-d495-4353-877e-88bcd46dfdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-690605867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dab1633-d842-48f8-87de-2aba373e2a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583e20ef5f3049fc8f94df0c4557b8e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:29Z,use_quota=True,user_id='a54e6af5ca264a2aa6f6a9cfad827859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e16e490-e5de-42fd-9c7f-d34c161039dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e16e490-e5de-42fd-9c7f-d34c161039dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34528c72-b855-48e0-8d96-0bb1e738dcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34528c72-b855-48e0-8d96-0bb1e738dcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dab1633-d842-48f8-87de-2aba373e2a9f', 'volume_name': 'volume-0dab1633-d842-48f8-87de-2aba373e2a9f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df35a062-acf9-4cf5-9351-b384e54d4ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df35a062-acf9-4cf5-9351-b384e54d4ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfebf183-25c9-4548-bd5b-ad86635f1af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:29 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Volume 0dab1633-d842-48f8-87de-2aba373e2a9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dab1633-d842-48f8-87de-2aba373e2a9f', 'volume_size': 1} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-690605867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dab1633-d842-48f8-87de-2aba373e2a9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583e20ef5f3049fc8f94df0c4557b8e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:29Z,use_quota=True,user_id='a54e6af5ca264a2aa6f6a9cfad827859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Creating volume 0dab1633-d842-48f8-87de-2aba373e2a9f {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:47:29 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:47:29 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f 1073741824 Sep 21 16:47:29 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Flow 'volume_create_manager' (8d82252b-ff94-41d8-9e2a-e9629fd13fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77087e4-49a5-42f7-9fb3-c8eaec27a628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77087e4-49a5-42f7-9fb3-c8eaec27a628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-487857929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b82ed5-dad3-4bc4-b620-36217e65fc91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda2abc1e58647f78c39c1da384eaf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:29Z,use_quota=True,user_id='3356e3c293224bba9ba16b7ffe54c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d20ef8b-4506-48aa-b45b-47f7784e6493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d20ef8b-4506-48aa-b45b-47f7784e6493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1bfaf1-07b2-4436-acba-12fef5d8b335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1bfaf1-07b2-4436-acba-12fef5d8b335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3b82ed5-dad3-4bc4-b620-36217e65fc91', 'volume_name': 'volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bda8be8-402b-4730-bdf2-81488e772a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bda8be8-402b-4730-bdf2-81488e772a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d889891-d01d-4129-acaa-799a2defe6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:29 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Volume a3b82ed5-dad3-4bc4-b620-36217e65fc91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91', 'volume_size': 1} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:29 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f 1073741824" returned: 0 in 0.454s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:29 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f Sep 21 16:47:29 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:29 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f" returned: 0 in 0.271s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-487857929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b82ed5-dad3-4bc4-b620-36217e65fc91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda2abc1e58647f78c39c1da384eaf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:29Z,use_quota=True,user_id='3356e3c293224bba9ba16b7ffe54c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Creating volume a3b82ed5-dad3-4bc4-b620-36217e65fc91 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:47:29 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfebf183-25c9-4548-bd5b-ad86635f1af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dab1633-d842-48f8-87de-2aba373e2a9f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:29 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 1073741824 Sep 21 16:47:29 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abace620-991a-40c0-a9d3-d00f251647b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:29 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Volume volume-0dab1633-d842-48f8-87de-2aba373e2a9f (0dab1633-d842-48f8-87de-2aba373e2a9f): created successfully Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abace620-991a-40c0-a9d3-d00f251647b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Flow 'volume_create_manager' (ff8d847d-efca-41a3-8cdd-cac04c3fab36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:29 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b711bab4-86e5-4d1d-a2fa-0879f4213461 tempest-VolumesSnapshotListTestJSON-520190576 None] Created volume successfully. Sep 21 16:47:30 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 1073741824" returned: 0 in 0.401s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:30 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 Sep 21 16:47:30 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:30 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91" returned: 0 in 0.245s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:47:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d889891-d01d-4129-acaa-799a2defe6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370bf3aa-d396-4d8c-8cd0-3b4ffee8b209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:30 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Volume volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 (a3b82ed5-dad3-4bc4-b620-36217e65fc91): created successfully Sep 21 16:47:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370bf3aa-d396-4d8c-8cd0-3b4ffee8b209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Flow 'volume_create_manager' (8d82252b-ff94-41d8-9e2a-e9629fd13fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:30 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-20a33ee6-c089-4645-afd3-ed7005140ad4 tempest-VolumesSnapshotTestJSON-299513393 None] Created volume successfully. Sep 21 16:47:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] Creating offline snapshot 31e74b10-d6dc-403b-8f08-4f2bdd50e782 of volume 0dab1633-d842-48f8-87de-2aba373e2a9f {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:47:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:31 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[0062605b-297f-472c-9aff-ca875bb125bb]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:31 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f Sep 21 16:47:31 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:31 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f" returned: 0 in 0.356s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:31 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 1G Sep 21 16:47:31 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:31 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 1G" returned: 0 in 0.384s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dab1633-d842-48f8-87de-2aba373e2a9f -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:32 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dab1633-d842-48f8-87de-2aba373e2a9f -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 Sep 21 16:47:32 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:32 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dab1633-d842-48f8-87de-2aba373e2a9f -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782" returned: 0 in 0.294s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:32 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 is being set with open permissions: ugo+rw Sep 21 16:47:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:32 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 Sep 21 16:47:32 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:32 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782" returned: 0 in 0.235s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:32 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.info Sep 21 16:47:32 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:32 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.info" returned: 0 in 0.256s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:32 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.info is being set with open permissions: ugo+rw Sep 21 16:47:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:32 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.info Sep 21 16:47:32 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:33 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.info" returned: 0 in 0.236s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.819s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] Creating offline snapshot e18c1411-2345-4011-a21e-d0023d3454d6 of volume a3b82ed5-dad3-4bc4-b620-36217e65fc91 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:47:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-55e193b3-bca8-4ed6-b9c7-59006c6f8a74 tempest-VolumesSnapshotListTestJSON-520190576 None] Create snapshot completed successfully Sep 21 16:47:33 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[f342a256-1b9a-431d-a3e9-65b97c752029]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:33 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 Sep 21 16:47:33 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:33 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91" returned: 0 in 0.389s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:33 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 1G Sep 21 16:47:33 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:33 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 1G" returned: 0 in 0.384s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:33 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 Sep 21 16:47:33 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:34 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6" returned: 0 in 0.288s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:34 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 is being set with open permissions: ugo+rw Sep 21 16:47:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:34 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 Sep 21 16:47:34 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:34 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6" returned: 0 in 0.254s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:34 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.info Sep 21 16:47:34 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:34 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.info" returned: 0 in 0.264s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:34 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.info is being set with open permissions: ugo+rw Sep 21 16:47:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:34 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.info Sep 21 16:47:34 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:34 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.info" returned: 0 in 0.238s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.551s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] Creating offline snapshot 82e78328-7feb-4a94-9457-6b8bee5b4d6a of volume 0dab1633-d842-48f8-87de-2aba373e2a9f {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:47:35 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d88e78-0821-498c-87ac-b71e6ddb7a0c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:35 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-00977f3d-2ade-4708-9b8e-5bfd8c72d583 tempest-VolumesSnapshotTestJSON-299513393 None] Create snapshot completed successfully Sep 21 16:47:35 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 Sep 21 16:47:35 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:35 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782" returned: 0 in 0.368s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dab1633-d842-48f8-87de-2aba373e2a9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:47:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:35 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a 1G Sep 21 16:47:35 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:35 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a 1G" returned: 0 in 0.485s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:35 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a Sep 21 16:47:35 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:35 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:47:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Flow 'volume_create_manager' (ba42f17e-4d0f-41cd-aac3-02e3239520b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08b205c-e0e7-44b4-8fc4-b7010d477e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08b205c-e0e7-44b4-8fc4-b7010d477e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1407523738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631cc444-4523-4757-bc23-3649f3e09ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda2abc1e58647f78c39c1da384eaf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e18c1411-2345-4011-a21e-d0023d3454d6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:36Z,use_quota=True,user_id='3356e3c293224bba9ba16b7ffe54c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8837708-7b2b-4eff-8d2a-f9c69cb2f761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8837708-7b2b-4eff-8d2a-f9c69cb2f761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a872bd1d-83b0-410b-b94d-7578dd0b8e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a872bd1d-83b0-410b-b94d-7578dd0b8e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '631cc444-4523-4757-bc23-3649f3e09ac1', 'volume_name': 'volume-631cc444-4523-4757-bc23-3649f3e09ac1', 'volume_size': 2, 'snapshot_id': 'e18c1411-2345-4011-a21e-d0023d3454d6'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7380ab3-048f-4c31-abae-75ea5f98a97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7380ab3-048f-4c31-abae-75ea5f98a97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712a7441-caa7-4844-8897-a338f692c51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:36 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Volume 631cc444-4523-4757-bc23-3649f3e09ac1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-631cc444-4523-4757-bc23-3649f3e09ac1', 'volume_size': 2, 'snapshot_id': 'e18c1411-2345-4011-a21e-d0023d3454d6'} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:36 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a" returned: 0 in 0.287s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:36 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a is being set with open permissions: ugo+rw Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:36 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a Sep 21 16:47:36 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:36 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a" returned: 0 in 0.241s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.479s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.427s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-e18c1411-2345-4011-a21e-d0023d3454d6-631cc444-4523-4757-bc23-3649f3e09ac1" by "_create_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-e18c1411-2345-4011-a21e-d0023d3454d6-631cc444-4523-4757-bc23-3649f3e09ac1" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Creating volume 631cc444-4523-4757-bc23-3649f3e09ac1 from snapshot e18c1411-2345-4011-a21e-d0023d3454d6 {{(pid=86030) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-631cc444-4523-4757-bc23-3649f3e09ac1" by "_copy_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:36 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-58e6f411-d6af-4a2f-9bfd-2e83ebd02981 tempest-VolumesSnapshotListTestJSON-520190576 None] Create snapshot completed successfully Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-631cc444-4523-4757-bc23-3649f3e09ac1" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] snapshot: e18c1411-2345-4011-a21e-d0023d3454d6, volume: 631cc444-4523-4757-bc23-3649f3e09ac1, {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d294ba-9bad-4627-8fbe-19752be79a6c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:36 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 Sep 21 16:47:36 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:36 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6" returned: 0 in 0.350s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc66d23-b85d-4646-878e-9e4e5f0aefa9]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:37 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 Sep 21 16:47:37 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:37 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91" returned: 0 in 0.354s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 16:47:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Creating direct copy from snapshot {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 16:47:37 devstack cinder-volume[86030]: DEBUG cinder.utils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Path /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1 not found in is_blk_device check {{(pid=86030) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 21 16:47:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:37 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1 Sep 21 16:47:37 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:43 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1" returned: 0 in 6.163s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1 {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:47:43 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Converted 1024.00 MB image at 166.13 MB/s Sep 21 16:47:43 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1 is being set with open permissions: ugo+rw Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:43 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1 Sep 21 16:47:43 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:43 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1" returned: 0 in 0.238s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-631cc444-4523-4757-bc23-3649f3e09ac1" released by "_copy_volume_from_snapshot" :: held 7.191s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-e18c1411-2345-4011-a21e-d0023d3454d6-631cc444-4523-4757-bc23-3649f3e09ac1" released by "_create_volume_from_snapshot" :: held 7.258s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.286s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.953s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] Creating offline snapshot 3be398d5-eacb-47b0-8e33-84d9890d025f of volume 0dab1633-d842-48f8-87de-2aba373e2a9f {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712a7441-caa7-4844-8897-a338f692c51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631cc444-4523-4757-bc23-3649f3e09ac1', 'volume_size': 2, 'snapshot_id': 'e18c1411-2345-4011-a21e-d0023d3454d6'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae885139-72e1-46ec-bf58-d92456a29683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b275ed56-b20d-4701-a5c0-c3c519bc13a1]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:43 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Volume volume-631cc444-4523-4757-bc23-3649f3e09ac1 (631cc444-4523-4757-bc23-3649f3e09ac1): created successfully Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae885139-72e1-46ec-bf58-d92456a29683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Flow 'volume_create_manager' (ba42f17e-4d0f-41cd-aac3-02e3239520b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5bf4ba9d-866f-409a-b574-57576e4315db tempest-VolumesSnapshotTestJSON-299513393 None] Created volume successfully. Sep 21 16:47:43 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a Sep 21 16:47:43 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:44 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a" returned: 0 in 0.349s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dab1633-d842-48f8-87de-2aba373e2a9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:47:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:44 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f 1G Sep 21 16:47:44 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:44 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f 1G" returned: 0 in 0.473s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:44 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f Sep 21 16:47:44 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-631cc444-4523-4757-bc23-3649f3e09ac1-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-631cc444-4523-4757-bc23-3649f3e09ac1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-631cc444-4523-4757-bc23-3649f3e09ac1" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-631cc444-4523-4757-bc23-3649f3e09ac1" acquired by "delete_volume" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:44 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[7917a649-e372-49bf-9e9b-0d64d1ec6319]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:44 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1 Sep 21 16:47:44 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:44 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f" returned: 0 in 0.304s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:44 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f is being set with open permissions: ugo+rw Sep 21 16:47:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:44 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f Sep 21 16:47:45 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:45 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1" returned: 0 in 0.376s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:45 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1 Sep 21 16:47:45 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:45 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f" returned: 0 in 0.257s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.495s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:45 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b94f7ab5-adde-4605-adf5-b5e5f95ed299 tempest-VolumesSnapshotListTestJSON-520190576 None] Create snapshot completed successfully Sep 21 16:47:45 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-631cc444-4523-4757-bc23-3649f3e09ac1" returned: 0 in 0.264s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-631cc444-4523-4757-bc23-3649f3e09ac1" released by "delete_volume" :: held 0.683s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Created reservations ['af88e4db-f214-4a92-b42e-a6a138eaccd4', 'c80f1724-f995-4ca2-8933-df086f6afa9c', '0bd27a7b-3686-45f8-b8f8-561de6207ae2', 'fce0d02c-cd09-4cdb-b7d6-ee4aeba4404b'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:45 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:47:45 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:45 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.258s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:47:45 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Deleted volume successfully. Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e77177d4-ed09-4d6c-bd2d-9279495bf036 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-631cc444-4523-4757-bc23-3649f3e09ac1-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-e18c1411-2345-4011-a21e-d0023d3454d6-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-e18c1411-2345-4011-a21e-d0023d3454d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-a3b82ed5-dad3-4bc4-b620-36217e65fc91" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-a3b82ed5-dad3-4bc4-b620-36217e65fc91" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-e18c1411-2345-4011-a21e-d0023d3454d6" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-e18c1411-2345-4011-a21e-d0023d3454d6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Deleting offline snapshot e18c1411-2345-4011-a21e-d0023d3454d6 of volume a3b82ed5-dad3-4bc4-b620-36217e65fc91 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] snapshot_file for this snap is: volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21a277f-e13a-4725-9f79-dcbffa7fad02]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:46 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 Sep 21 16:47:46 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:46 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6" returned: 0 in 0.386s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:47:46 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaf525c-017e-402a-ad74-527083f3c7f4]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:46 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 Sep 21 16:47:46 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:46 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91" returned: 0 in 0.567s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:47 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 Sep 21 16:47:47 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "cinder-3be398d5-eacb-47b0-8e33-84d9890d025f-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-3be398d5-eacb-47b0-8e33-84d9890d025f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "cinder-quobyte-0dab1633-d842-48f8-87de-2aba373e2a9f" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-0dab1633-d842-48f8-87de-2aba373e2a9f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "cinder-quobyte-3be398d5-eacb-47b0-8e33-84d9890d025f" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-3be398d5-eacb-47b0-8e33-84d9890d025f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Deleting offline snapshot 3be398d5-eacb-47b0-8e33-84d9890d025f of volume 0dab1633-d842-48f8-87de-2aba373e2a9f {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] snapshot_file for this snap is: volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[feda7334-723b-4b7d-b0b9-ae9c226df74a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:47 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f Sep 21 16:47:47 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:47 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6" returned: 0 in 0.355s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:47 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6 Sep 21 16:47:47 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:47 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f" returned: 0 in 0.372s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dab1633-d842-48f8-87de-2aba373e2a9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5eb4bb5-0332-48a1-96d7-3ce0d4c6a771]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:47 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91.e18c1411-2345-4011-a21e-d0023d3454d6" returned: 0 in 0.261s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-e18c1411-2345-4011-a21e-d0023d3454d6" released by "_delete_snapshot" :: held 1.689s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-a3b82ed5-dad3-4bc4-b620-36217e65fc91" released by "delete_snapshot" :: held 1.711s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:47 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a Sep 21 16:47:47 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Created reservations ['1292079a-e498-422f-9327-2c75ed01e98c', 'e34f6ef6-fa30-421b-9036-b8cf780460df', 'd06f1f34-dbf1-4423-b4ab-39f427e0bd8a', '0a241b8e-e6fb-4a05-9807-215d6d0d2bc8'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:47 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Delete snapshot completed successfully. Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-83de11bf-0011-4182-bc8a-81fca48f5e06 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-e18c1411-2345-4011-a21e-d0023d3454d6-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:47 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a" returned: 0 in 0.370s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dab1633-d842-48f8-87de-2aba373e2a9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:47:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:47 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f Sep 21 16:47:47 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-a3b82ed5-dad3-4bc4-b620-36217e65fc91-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-a3b82ed5-dad3-4bc4-b620-36217e65fc91-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-a3b82ed5-dad3-4bc4-b620-36217e65fc91" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-a3b82ed5-dad3-4bc4-b620-36217e65fc91" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ceb0bd-f3b0-4934-a289-67c44a89d169]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:48 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f" returned: 0 in 0.421s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:48 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 Sep 21 16:47:48 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:48 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f Sep 21 16:47:48 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:48 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.3be398d5-eacb-47b0-8e33-84d9890d025f" returned: 0 in 0.250s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:48 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91" returned: 0 in 0.378s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-3be398d5-eacb-47b0-8e33-84d9890d025f" released by "_delete_snapshot" :: held 1.538s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-0dab1633-d842-48f8-87de-2aba373e2a9f" released by "delete_snapshot" :: held 1.564s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:48 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91 Sep 21 16:47:48 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Created reservations ['1d0b803c-c15f-4d44-9541-92852d76deba', '9b74b794-631b-40ac-a43b-7d07b7e07ba3', '6d069f37-80b8-461d-b8eb-58ee0af775b2', 'ea4bb910-7b86-460d-8b06-164b5a4ea153'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Delete snapshot completed successfully. Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d0f5f3a0-2251-43b0-be50-cce1773b18f0 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-3be398d5-eacb-47b0-8e33-84d9890d025f-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:48 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a3b82ed5-dad3-4bc4-b620-36217e65fc91" returned: 0 in 0.247s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-a3b82ed5-dad3-4bc4-b620-36217e65fc91" released by "delete_volume" :: held 0.685s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Created reservations ['2bbc517a-119e-441f-8657-052e73c3ac04', 'f2db78be-ac55-40aa-a117-8cbdb2610289', 'a8ecfe6e-7589-42c7-8fa9-e25fe4e0976b', '3487501a-ff9d-4610-9cea-5b4426f0e51d'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:49 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:47:49 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "cinder-82e78328-7feb-4a94-9457-6b8bee5b4d6a-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-82e78328-7feb-4a94-9457-6b8bee5b4d6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "cinder-quobyte-0dab1633-d842-48f8-87de-2aba373e2a9f" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:49 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-0dab1633-d842-48f8-87de-2aba373e2a9f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "cinder-quobyte-82e78328-7feb-4a94-9457-6b8bee5b4d6a" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.291s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:47:49 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Deleted volume successfully. Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-82e78328-7feb-4a94-9457-6b8bee5b4d6a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Deleting offline snapshot 82e78328-7feb-4a94-9457-6b8bee5b4d6a of volume 0dab1633-d842-48f8-87de-2aba373e2a9f {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] snapshot_file for this snap is: volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[7277d799-81e8-4419-ad47-088af878764f]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2c0916be-dbf6-442b-b247-562f6fb43fae tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-a3b82ed5-dad3-4bc4-b620-36217e65fc91-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:49 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a Sep 21 16:47:49 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:49 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a" returned: 0 in 0.395s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dab1633-d842-48f8-87de-2aba373e2a9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efffab4-7d1f-470c-9597-7bc96cdb0a3a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Flow 'volume_create_manager' (156b0f3b-ff97-49d9-be70-f65cb7c34666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee42877-d712-4be9-b704-ba38763c0ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee42877-d712-4be9-b704-ba38763c0ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1383397640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54728d59-5a15-462b-bb82-7fed5b15159f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda2abc1e58647f78c39c1da384eaf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:50Z,use_quota=True,user_id='3356e3c293224bba9ba16b7ffe54c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd085ba-b664-49f2-adb2-fa5b4c17a5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:49 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 Sep 21 16:47:49 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd085ba-b664-49f2-adb2-fa5b4c17a5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7e2a90-17b7-4f52-a51f-b1396a25eaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7e2a90-17b7-4f52-a51f-b1396a25eaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54728d59-5a15-462b-bb82-7fed5b15159f', 'volume_name': 'volume-54728d59-5a15-462b-bb82-7fed5b15159f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d109c44-7f4f-406f-b277-23f67969406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d109c44-7f4f-406f-b277-23f67969406b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3f0e64-1f56-4608-8e79-1e566ef8ee2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:49 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Volume 54728d59-5a15-462b-bb82-7fed5b15159f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54728d59-5a15-462b-bb82-7fed5b15159f', 'volume_size': 1} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1383397640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54728d59-5a15-462b-bb82-7fed5b15159f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda2abc1e58647f78c39c1da384eaf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:50Z,use_quota=True,user_id='3356e3c293224bba9ba16b7ffe54c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Creating volume 54728d59-5a15-462b-bb82-7fed5b15159f {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:47:49 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:47:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:49 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f 1073741824 Sep 21 16:47:49 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:50 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782" returned: 0 in 0.369s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dab1633-d842-48f8-87de-2aba373e2a9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:50 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a Sep 21 16:47:50 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:50 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f 1073741824" returned: 0 in 0.455s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:50 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f Sep 21 16:47:50 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:50 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a" returned: 0 in 0.418s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:50 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a Sep 21 16:47:50 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:50 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f" returned: 0 in 0.268s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3f0e64-1f56-4608-8e79-1e566ef8ee2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54728d59-5a15-462b-bb82-7fed5b15159f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4149bf5-9d5c-4a72-8816-d4fa9d0a0c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:50 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Volume volume-54728d59-5a15-462b-bb82-7fed5b15159f (54728d59-5a15-462b-bb82-7fed5b15159f): created successfully Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4149bf5-9d5c-4a72-8816-d4fa9d0a0c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Flow 'volume_create_manager' (156b0f3b-ff97-49d9-be70-f65cb7c34666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:50 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-383b6597-26bd-412c-aecb-969b275c561a tempest-VolumesSnapshotTestJSON-299513393 None] Created volume successfully. Sep 21 16:47:50 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.82e78328-7feb-4a94-9457-6b8bee5b4d6a" returned: 0 in 0.278s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-82e78328-7feb-4a94-9457-6b8bee5b4d6a" released by "_delete_snapshot" :: held 1.578s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-0dab1633-d842-48f8-87de-2aba373e2a9f" released by "delete_snapshot" :: held 1.608s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:50 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Created reservations ['73c4e09e-3201-457c-b139-6a0112ae331f', '4ef191eb-e93d-411d-9439-336aaa24d595', '8f66cd4f-e050-454b-b896-648dd600a757', '76b2da96-b39d-4fb0-b877-354329f8e2bc'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:51 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Delete snapshot completed successfully. Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e2786e8f-8c18-4879-915c-e5057ec34998 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-82e78328-7feb-4a94-9457-6b8bee5b4d6a-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] Creating offline snapshot f69e9eec-6445-4969-bef0-09ca1a1a02d8 of volume 54728d59-5a15-462b-bb82-7fed5b15159f {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa550f0-5fd7-4522-b5be-89342474ed5b]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:51 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f Sep 21 16:47:51 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "cinder-31e74b10-d6dc-403b-8f08-4f2bdd50e782-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-31e74b10-d6dc-403b-8f08-4f2bdd50e782-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "cinder-quobyte-0dab1633-d842-48f8-87de-2aba373e2a9f" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-0dab1633-d842-48f8-87de-2aba373e2a9f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "cinder-quobyte-31e74b10-d6dc-403b-8f08-4f2bdd50e782" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-31e74b10-d6dc-403b-8f08-4f2bdd50e782" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:51 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Deleting offline snapshot 31e74b10-d6dc-403b-8f08-4f2bdd50e782 of volume 0dab1633-d842-48f8-87de-2aba373e2a9f {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] snapshot_file for this snap is: volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f" returned: 0 in 0.399s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd865c0f-e394-4fa7-8132-b9ab3d4ad4ce]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:51 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 1G Sep 21 16:47:51 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:51 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 Sep 21 16:47:51 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:51 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 1G" returned: 0 in 0.407s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54728d59-5a15-462b-bb82-7fed5b15159f -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:51 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782" returned: 0 in 0.410s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dab1633-d842-48f8-87de-2aba373e2a9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:47:51 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54728d59-5a15-462b-bb82-7fed5b15159f -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 Sep 21 16:47:51 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8b51a1-e647-4ab6-a44d-3832fcff6fc4]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:52 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f Sep 21 16:47:52 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:52 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54728d59-5a15-462b-bb82-7fed5b15159f -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8" returned: 0 in 0.298s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:52 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 is being set with open permissions: ugo+rw Sep 21 16:47:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:52 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 Sep 21 16:47:52 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:52 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f" returned: 0 in 0.386s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:52 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 Sep 21 16:47:52 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:52 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8" returned: 0 in 0.274s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:52 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.info Sep 21 16:47:52 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:52 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782" returned: 0 in 0.339s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:52 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782 Sep 21 16:47:52 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:52 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.info" returned: 0 in 0.276s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:52 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.info is being set with open permissions: ugo+rw Sep 21 16:47:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:52 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.info Sep 21 16:47:52 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:52 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f.31e74b10-d6dc-403b-8f08-4f2bdd50e782" returned: 0 in 0.282s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-31e74b10-d6dc-403b-8f08-4f2bdd50e782" released by "_delete_snapshot" :: held 1.544s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-0dab1633-d842-48f8-87de-2aba373e2a9f" released by "delete_snapshot" :: held 1.568s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:53 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.info" returned: 0 in 0.266s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:53 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4b7b7641-b95e-4609-a69c-8c8c7ce4ffcf tempest-VolumesSnapshotTestJSON-299513393 None] Create snapshot completed successfully Sep 21 16:47:53 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Created reservations ['a3019e52-51c2-4661-8f10-025b365113bf', 'fcf98d8d-0d6f-4942-8d3a-bf65f7f274e1', '2a5b2b84-efea-4785-8d4f-3243ce9db7f1', 'a2eb6e3a-fd79-4ce7-abdf-fc55603d2270'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:53 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Delete snapshot completed successfully. Sep 21 16:47:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b8d95869-811d-4e36-a9a6-01fdb2cd3803 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-31e74b10-d6dc-403b-8f08-4f2bdd50e782-delete_snapshot" released by "delete_snapshot" :: held 1.737s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "cinder-0dab1633-d842-48f8-87de-2aba373e2a9f-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-0dab1633-d842-48f8-87de-2aba373e2a9f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "cinder-quobyte-0dab1633-d842-48f8-87de-2aba373e2a9f" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-0dab1633-d842-48f8-87de-2aba373e2a9f" acquired by "delete_volume" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:53 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ba4bab-6d4c-4f8c-bc97-1df4f08de84c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:53 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f Sep 21 16:47:53 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:54 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f" returned: 0 in 0.377s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:54 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f Sep 21 16:47:54 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:54 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0dab1633-d842-48f8-87de-2aba373e2a9f" returned: 0 in 0.279s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-quobyte-0dab1633-d842-48f8-87de-2aba373e2a9f" released by "delete_volume" :: held 0.724s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Created reservations ['c70d3b44-b27b-401a-bf28-98439ef733e1', '1d7c99eb-1059-48dd-aff0-e8d0a1955ad5', 'e5ae3211-425c-42b9-aa42-1e049040d4a7', '9fa75f78-33aa-48c7-ab0e-433d89485f66'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:54 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:47:54 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Flow 'volume_create_manager' (0b5560d8-f000-40c9-a6e5-3004faff2eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0022918-09c5-4424-b284-32708b932aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0022918-09c5-4424-b284-32708b932aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1695395533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2984c0cd-a593-41f8-a07f-8e18ba398e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda2abc1e58647f78c39c1da384eaf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f69e9eec-6445-4969-bef0-09ca1a1a02d8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:47:55Z,use_quota=True,user_id='3356e3c293224bba9ba16b7ffe54c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9008fc9-4640-44d6-91ac-8e391f2c9211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9008fc9-4640-44d6-91ac-8e391f2c9211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eafa30-f24e-4f48-9dd6-a8079d33005b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eafa30-f24e-4f48-9dd6-a8079d33005b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2984c0cd-a593-41f8-a07f-8e18ba398e70', 'volume_name': 'volume-2984c0cd-a593-41f8-a07f-8e18ba398e70', 'volume_size': 1, 'snapshot_id': 'f69e9eec-6445-4969-bef0-09ca1a1a02d8'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:54 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9405debe-66c6-4e7d-a325-f045274587a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9405debe-66c6-4e7d-a325-f045274587a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff57c843-ade3-4828-9712-156497016b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:47:54 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Volume 2984c0cd-a593-41f8-a07f-8e18ba398e70: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2984c0cd-a593-41f8-a07f-8e18ba398e70', 'volume_size': 1, 'snapshot_id': 'f69e9eec-6445-4969-bef0-09ca1a1a02d8'} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.285s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-f69e9eec-6445-4969-bef0-09ca1a1a02d8-2984c0cd-a593-41f8-a07f-8e18ba398e70" by "_create_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:54 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Deleted volume successfully. Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-f69e9eec-6445-4969-bef0-09ca1a1a02d8-2984c0cd-a593-41f8-a07f-8e18ba398e70" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Creating volume 2984c0cd-a593-41f8-a07f-8e18ba398e70 from snapshot f69e9eec-6445-4969-bef0-09ca1a1a02d8 {{(pid=86030) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-2984c0cd-a593-41f8-a07f-8e18ba398e70" by "_copy_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-732fa3de-6ce5-480b-8e9d-752f58f23a49 tempest-VolumesSnapshotListTestJSON-520190576 None] Lock "cinder-0dab1633-d842-48f8-87de-2aba373e2a9f-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-2984c0cd-a593-41f8-a07f-8e18ba398e70" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] snapshot: f69e9eec-6445-4969-bef0-09ca1a1a02d8, volume: 2984c0cd-a593-41f8-a07f-8e18ba398e70, {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef10f2a-7c04-426c-9054-22a119d4b511]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:55 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 Sep 21 16:47:55 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:55 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8" returned: 0 in 0.407s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54728d59-5a15-462b-bb82-7fed5b15159f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:47:55 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a6b189-9e7b-491e-ba63-7612b52e56cf]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:47:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:55 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f Sep 21 16:47:55 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:47:55 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 21 16:47:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f" returned: 0 in 0.395s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:47:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 16:47:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Creating direct copy from snapshot {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 16:47:55 devstack cinder-volume[86030]: DEBUG cinder.utils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Path /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70 not found in is_blk_device check {{(pid=86030) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 21 16:47:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:47:55 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70 Sep 21 16:47:55 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:02 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70" returned: 0 in 7.055s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:02 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f, size 1024.00 MB, duration 7.06 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70 {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:48:02 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Converted 1024.00 MB image at 145.11 MB/s Sep 21 16:48:02 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70 is being set with open permissions: ugo+rw Sep 21 16:48:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:02 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70 Sep 21 16:48:02 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:03 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70" returned: 0 in 0.267s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-2984c0cd-a593-41f8-a07f-8e18ba398e70" released by "_copy_volume_from_snapshot" :: held 8.221s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=140,cinder:INSERT=46,cinder:SELECT=133,cinder:DELETE=14 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-f69e9eec-6445-4969-bef0-09ca1a1a02d8-2984c0cd-a593-41f8-a07f-8e18ba398e70" released by "_create_volume_from_snapshot" :: held 8.300s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.318s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff57c843-ade3-4828-9712-156497016b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2984c0cd-a593-41f8-a07f-8e18ba398e70', 'volume_size': 1, 'snapshot_id': 'f69e9eec-6445-4969-bef0-09ca1a1a02d8'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1516f1f9-6abc-4abb-b072-7197b4d6a356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:48:03 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Volume volume-2984c0cd-a593-41f8-a07f-8e18ba398e70 (2984c0cd-a593-41f8-a07f-8e18ba398e70): created successfully Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1516f1f9-6abc-4abb-b072-7197b4d6a356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Flow 'volume_create_manager' (0b5560d8-f000-40c9-a6e5-3004faff2eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:48:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-dbba4c0c-68ac-492f-b3e9-139b5e3da40c tempest-VolumesSnapshotTestJSON-299513393 None] Created volume successfully. Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-2984c0cd-a593-41f8-a07f-8e18ba398e70-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-2984c0cd-a593-41f8-a07f-8e18ba398e70-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-2984c0cd-a593-41f8-a07f-8e18ba398e70" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-2984c0cd-a593-41f8-a07f-8e18ba398e70" acquired by "delete_volume" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fe0a52-8ca1-4524-a84d-1a028aca0e9c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:48:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:03 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70 Sep 21 16:48:03 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:04 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70" returned: 0 in 0.388s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:04 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70 Sep 21 16:48:04 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:04 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2984c0cd-a593-41f8-a07f-8e18ba398e70" returned: 0 in 0.268s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-2984c0cd-a593-41f8-a07f-8e18ba398e70" released by "delete_volume" :: held 0.722s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=146,cinder:SELECT=126,cinder:INSERT=41,cinder:DELETE=10 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Created reservations ['ad85ca53-7c9a-4d3f-b485-5cd386e13f58', '5917e6ac-2d90-4857-b8d6-613e439ef206', 'a5e29793-f4a8-4133-b8d2-c4f299a8aed4', '87bba6b1-e934-4f5d-84c4-5dc46a624423'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:04 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:48:04 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:04 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.277s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-f69e9eec-6445-4969-bef0-09ca1a1a02d8-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:48:04 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Deleted volume successfully. Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-f69e9eec-6445-4969-bef0-09ca1a1a02d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-54728d59-5a15-462b-bb82-7fed5b15159f" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-62f6af69-aa32-40ab-991d-89ff1072bcbf tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-2984c0cd-a593-41f8-a07f-8e18ba398e70-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-54728d59-5a15-462b-bb82-7fed5b15159f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-f69e9eec-6445-4969-bef0-09ca1a1a02d8" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-f69e9eec-6445-4969-bef0-09ca1a1a02d8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Deleting offline snapshot f69e9eec-6445-4969-bef0-09ca1a1a02d8 of volume 54728d59-5a15-462b-bb82-7fed5b15159f {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] snapshot_file for this snap is: volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d15c82-4b9c-406a-85d9-5d2a0409a88d]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:48:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:05 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 Sep 21 16:48:05 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:05 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8" returned: 0 in 0.355s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54728d59-5a15-462b-bb82-7fed5b15159f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:48:05 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcad334-e3c4-4441-ba1e-9198a556fb48]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:48:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:05 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f Sep 21 16:48:05 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:05 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f" returned: 0 in 0.534s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:05 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 Sep 21 16:48:05 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:06 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8" returned: 0 in 0.321s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:06 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8 Sep 21 16:48:06 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:06 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f.f69e9eec-6445-4969-bef0-09ca1a1a02d8" returned: 0 in 0.240s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-f69e9eec-6445-4969-bef0-09ca1a1a02d8" released by "_delete_snapshot" :: held 1.558s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:48:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-54728d59-5a15-462b-bb82-7fed5b15159f" released by "delete_snapshot" :: held 1.580s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:48:06 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Created reservations ['ab7ee8a4-2f61-47a2-a2ca-f5ce6b2b1dbd', '0e28e986-4ad9-4a9c-b776-6e48c5b184c6', '2a260602-84f3-4610-bd90-045f8748bd2c', '046d6e67-6fcf-499b-bbd1-381244cbf829'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:48:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Delete snapshot completed successfully. Sep 21 16:48:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-e22380d9-068b-4a9f-9bc0-c1a343a1a8a4 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-f69e9eec-6445-4969-bef0-09ca1a1a02d8-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-54728d59-5a15-462b-bb82-7fed5b15159f-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-54728d59-5a15-462b-bb82-7fed5b15159f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-54728d59-5a15-462b-bb82-7fed5b15159f" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-54728d59-5a15-462b-bb82-7fed5b15159f" acquired by "delete_volume" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b21c2e4-af59-4237-9d91-f5a272e9ded5]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:07 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f Sep 21 16:48:07 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:07 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f" returned: 0 in 0.351s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:07 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f Sep 21 16:48:07 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:07 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-54728d59-5a15-462b-bb82-7fed5b15159f" returned: 0 in 0.250s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-54728d59-5a15-462b-bb82-7fed5b15159f" released by "delete_volume" :: held 0.664s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:07 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:48:07 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Created reservations ['b69521e5-0e24-4525-b065-da8fff624f5b', '60d592cd-b972-46f9-8ce7-d97ad4ca3c98', '1cd7bbe5-7cca-4b66-882e-bfb105c19870', 'aae86524-6f17-4601-8beb-252f7db44399'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:48:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:07 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:48:07 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:08 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.245s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 29 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:48:08 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.255s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:48:08 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Deleted volume successfully. Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-02978728-20d7-4a36-a0a1-1448956242a6 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-54728d59-5a15-462b-bb82-7fed5b15159f-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-c305f6ab-9d0e-43a3-a2ee-77809aaa776a-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-c305f6ab-9d0e-43a3-a2ee-77809aaa776a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "cinder-quobyte-c305f6ab-9d0e-43a3-a2ee-77809aaa776a" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-c305f6ab-9d0e-43a3-a2ee-77809aaa776a" acquired by "delete_volume" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1229d62d-db28-446e-ab9a-cd6a8b35e538]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:08 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a Sep 21 16:48:08 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:08 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a" returned: 0 in 0.354s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:08 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a Sep 21 16:48:08 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:09 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-c305f6ab-9d0e-43a3-a2ee-77809aaa776a" returned: 0 in 0.243s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-quobyte-c305f6ab-9d0e-43a3-a2ee-77809aaa776a" released by "delete_volume" :: held 0.652s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:48:09 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Created reservations ['60a9d914-e64f-4e04-9b33-2316b9043248', 'c77310de-6180-425e-952f-d2146de189ac', 'c78cc7f1-744d-4dc7-b228-397927de118d', '876c3973-7ea5-4eaf-a20f-89ec12d03f74'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:48:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:48:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:48:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:48:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:48:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:48:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:09 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:48:09 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:09 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.291s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:09 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:48:09 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Deleted volume successfully. Sep 21 16:48:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-dcd2aa14-c48a-47a6-8a58-b9e4c49aba99 tempest-VolumesSnapshotTestJSON-299513393 None] Lock "cinder-c305f6ab-9d0e-43a3-a2ee-77809aaa776a-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:48:19 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:INSERT=8,cinder:UPDATE=27,cinder:SELECT=16,cinder:DELETE=2 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:48:19 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=25,cinder:UPDATE=34,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:48:42 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Flow 'volume_create_manager' (58de5447-79dd-40ef-9aa5-9811e97ce918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e5bb1d-d973-496b-aaa0-49f92b3c4d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e5bb1d-d973-496b-aaa0-49f92b3c4d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1418513790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c449af-70d9-4907-8b62-8ba4f15f436e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2624447ae3c44b4a75a1c58f55f427b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:48:43Z,use_quota=True,user_id='e471e9ae403e4488841331ff2565f690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fe2349-7f98-4e7a-891d-1b945fbfaa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fe2349-7f98-4e7a-891d-1b945fbfaa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fe2575-85ee-4da3-ab76-4af71deea9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fe2575-85ee-4da3-ab76-4af71deea9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c449af-70d9-4907-8b62-8ba4f15f436e', 'volume_name': 'volume-13c449af-70d9-4907-8b62-8ba4f15f436e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbb813e-04e5-447b-b49e-431479e76b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbb813e-04e5-447b-b49e-431479e76b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3a0266-d20c-4476-9d10-80754dc6ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:48:43 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Volume 13c449af-70d9-4907-8b62-8ba4f15f436e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c449af-70d9-4907-8b62-8ba4f15f436e', 'volume_size': 1} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1418513790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c449af-70d9-4907-8b62-8ba4f15f436e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2624447ae3c44b4a75a1c58f55f427b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:48:43Z,use_quota=True,user_id='e471e9ae403e4488841331ff2565f690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Creating volume 13c449af-70d9-4907-8b62-8ba4f15f436e {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:48:43 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-13c449af-70d9-4907-8b62-8ba4f15f436e 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:43 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-13c449af-70d9-4907-8b62-8ba4f15f436e 1073741824 Sep 21 16:48:43 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:43 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-13c449af-70d9-4907-8b62-8ba4f15f436e 1073741824" returned: 0 in 0.447s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-13c449af-70d9-4907-8b62-8ba4f15f436e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:48:43 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-13c449af-70d9-4907-8b62-8ba4f15f436e Sep 21 16:48:43 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:48:43 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-13c449af-70d9-4907-8b62-8ba4f15f436e" returned: 0 in 0.248s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3a0266-d20c-4476-9d10-80754dc6ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c449af-70d9-4907-8b62-8ba4f15f436e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7fa649-127f-4323-8bfc-87992dcdeeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:48:43 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Volume volume-13c449af-70d9-4907-8b62-8ba4f15f436e (13c449af-70d9-4907-8b62-8ba4f15f436e): created successfully Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7fa649-127f-4323-8bfc-87992dcdeeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:48:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Flow 'volume_create_manager' (58de5447-79dd-40ef-9aa5-9811e97ce918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:48:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-81a96250-f53d-489f-bcd8-fb0b98ef6b2a tempest-TestMinimumBasicScenario-1815865124 None] Created volume successfully. Sep 21 16:48:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-b4589a56-d626-4b1f-91d2-da861e91c1bc req-15072c09-1877-4929-bc2c-e0ea98e6f940 tempest-TestMinimumBasicScenario-1815865124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:48:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-b4589a56-d626-4b1f-91d2-da861e91c1bc req-15072c09-1877-4929-bc2c-e0ea98e6f940 tempest-TestMinimumBasicScenario-1815865124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:48:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-b4589a56-d626-4b1f-91d2-da861e91c1bc req-15072c09-1877-4929-bc2c-e0ea98e6f940 tempest-TestMinimumBasicScenario-1815865124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:48:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-b4589a56-d626-4b1f-91d2-da861e91c1bc req-15072c09-1877-4929-bc2c-e0ea98e6f940 tempest-TestMinimumBasicScenario-1815865124 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-13c449af-70d9-4907-8b62-8ba4f15f436e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59dcbe5b-fa88-4204-a88e-385335a2adc1', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:48:45 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-b4589a56-d626-4b1f-91d2-da861e91c1bc req-15072c09-1877-4929-bc2c-e0ea98e6f940 tempest-TestMinimumBasicScenario-1815865124 None] attachment_update completed successfully. Sep 21 16:48:56 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=4,cinder:SELECT=8,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:48:56 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:49:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:49:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:49:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:49:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:49:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:49:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:49:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:49:07 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:49:07 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:49:08 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Sep 21 16:49:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.259s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:49:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:49:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:49:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 29 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:49:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:49:31 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-52e7869f-c82e-4759-ba7c-b3e9537365b0 req-3dccc058-013e-4b01-ada5-f23b117dd18b tempest-TestMinimumBasicScenario-1815865124 None] Terminate volume connection completed successfully. Sep 21 16:49:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-52e7869f-c82e-4759-ba7c-b3e9537365b0 req-3dccc058-013e-4b01-ada5-f23b117dd18b tempest-TestMinimumBasicScenario-1815865124 None] Deleting attachment 59dcbe5b-fa88-4204-a88e-385335a2adc1. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:49:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Acquiring lock "cinder-13c449af-70d9-4907-8b62-8ba4f15f436e-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:49:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Lock "cinder-13c449af-70d9-4907-8b62-8ba4f15f436e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:49:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Acquiring lock "cinder-quobyte-13c449af-70d9-4907-8b62-8ba4f15f436e" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:49:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Lock "cinder-quobyte-13c449af-70d9-4907-8b62-8ba4f15f436e" acquired by "delete_volume" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:49:32 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c7a853-f759-48e0-8681-bc12ccec6a46]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:49:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-13c449af-70d9-4907-8b62-8ba4f15f436e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:49:32 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-13c449af-70d9-4907-8b62-8ba4f15f436e Sep 21 16:49:32 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:49:32 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Sep 21 16:49:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-13c449af-70d9-4907-8b62-8ba4f15f436e" returned: 0 in 0.359s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:49:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-13c449af-70d9-4907-8b62-8ba4f15f436e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:49:32 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-13c449af-70d9-4907-8b62-8ba4f15f436e Sep 21 16:49:32 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:49:33 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Sep 21 16:49:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-13c449af-70d9-4907-8b62-8ba4f15f436e" returned: 0 in 0.252s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:49:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Lock "cinder-quobyte-13c449af-70d9-4907-8b62-8ba4f15f436e" released by "delete_volume" :: held 0.653s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:49:33 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Created reservations ['e2a5524a-c290-48be-823b-025e6b583525', '2a807d84-d075-44db-81e6-169f6db37ced', '30d09c22-1714-4dad-8512-08f032733964', 'bd7324e7-572f-427a-8f19-b7c776b7d301'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:49:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:49:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:49:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:49:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:49:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:49:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:49:33 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:49:33 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:49:33 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Sep 21 16:49:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.255s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:49:33 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:49:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Deleted volume successfully. Sep 21 16:49:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ab1fc85e-c603-4dd6-9a0e-0002674cd54c tempest-TestMinimumBasicScenario-1815865124 None] Lock "cinder-13c449af-70d9-4907-8b62-8ba4f15f436e-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:49:43 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:49:43 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:50:06 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:50:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Flow 'volume_create_manager' (7bd8cb42-2ea6-4d9a-8335-4734425d61e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:50:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47821a63-9467-479d-888d-4b680f93fb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:50:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47821a63-9467-479d-888d-4b680f93fb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1594901161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fea8a7-96b5-46dc-acff-6912957dbbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb24ba439cbc4362ba83a9c7ea7f7905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:50:06Z,use_quota=True,user_id='39954bc5d32749e2a983310ee3cd6dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:50:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c2b8e1-61d8-45f3-9d52-2dd3334eeb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:50:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c2b8e1-61d8-45f3-9d52-2dd3334eeb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:50:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdb820a-8128-4d60-93f6-d8f23c4edca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:50:06 devstack cinder-volume[86030]: DEBUG cinder.image.glance [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Creating Keystone auth plugin from conf {{(pid=86030) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 16:50:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bdb820a-8128-4d60-93f6-d8f23c4edca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9fea8a7-96b5-46dc-acff-6912957dbbcd', 'volume_name': 'volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:50:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0385acc4-5b78-4ef0-86ff-e0f1a5a60329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:50:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0385acc4-5b78-4ef0-86ff-e0f1a5a60329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:50:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b98a8c1-af97-4119-804c-64e516bc2b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:50:06 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Volume b9fea8a7-96b5-46dc-acff-6912957dbbcd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 21 16:50:06 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Trying to clone b9fea8a7-96b5-46dc-acff-6912957dbbcd from image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]). {{(pid=86030) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 16:50:07 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Image download 20.69 MB at 20.69 MB/s Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cdccfb-94e5-4cc7-a2ef-f4f64825e8a9]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:50:07 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD Sep 21 16:50:07 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:50:07 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Temporary image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c is fetched for user 39954bc5d32749e2a983310ee3cd6dd8. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd817814-6fd7-4167-9c5e-d3347f040e4d]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:50:07 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD Sep 21 16:50:07 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:50:07 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:50:07 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:50:07 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1594901161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fea8a7-96b5-46dc-acff-6912957dbbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb24ba439cbc4362ba83a9c7ea7f7905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:50:06Z,use_quota=True,user_id='39954bc5d32749e2a983310ee3cd6dd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Creating volume b9fea8a7-96b5-46dc-acff-6912957dbbcd {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:50:07 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:50:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:50:07 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd 1073741824 Sep 21 16:50:07 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:50:08 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 21 16:50:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.249s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:50:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:50:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:50:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 29 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:50:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:50:08 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Sep 21 16:50:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd 1073741824" returned: 0 in 0.406s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:50:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:50:08 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd Sep 21 16:50:08 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:50:08 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Sep 21 16:50:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd" returned: 0 in 0.249s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:50:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:50:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:50:08 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Attempting download of 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}])) to volume b9fea8a7-96b5-46dc-acff-6912957dbbcd. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 21 16:50:08 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc128414-59e1-4db2-b279-2c5431065e36]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:50:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_g5hfgkf9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:50:08 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_g5hfgkf9 Sep 21 16:50:08 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:50:08 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Sep 21 16:50:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_g5hfgkf9" returned: 0 in 0.324s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:50:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_g5hfgkf9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:50:09 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_g5hfgkf9 Sep 21 16:50:09 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:50:09 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Sep 21 16:50:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_g5hfgkf9" returned: 1 in 0.324s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:50:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_g5hfgkf9' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:50:09 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[7029977d-57a6-4428-a41e-c659cb053ad3]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:50:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:50:09 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD Sep 21 16:50:09 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:50:09 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Sep 21 16:50:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:50:09 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c was qcow2, converting to qcow2 {{(pid=86030) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 16:50:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:50:09 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd Sep 21 16:50:09 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:50:11 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Sep 21 16:50:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd" returned: 0 in 1.724s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:50:11 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c_210lfidqdevstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:50:11 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Converted 112.00 MB image at 64.92 MB/s Sep 21 16:50:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:50:11 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd 1G Sep 21 16:50:11 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:50:11 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 21 16:50:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd 1G" returned: 0 in 0.309s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:50:11 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Downloaded image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}])) to volume b9fea8a7-96b5-46dc-acff-6912957dbbcd successfully. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 21 16:50:11 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Temporary image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c for user 39954bc5d32749e2a983310ee3cd6dd8 is deleted. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 16:50:11 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Marking volume b9fea8a7-96b5-46dc-acff-6912957dbbcd as bootable. {{(pid=86030) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 21 16:50:11 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Copying metadata from image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c to b9fea8a7-96b5-46dc-acff-6912957dbbcd. {{(pid=86030) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 16:50:11 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Creating volume glance metadata for volume b9fea8a7-96b5-46dc-acff-6912957dbbcd backed by image 1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86030) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 16:50:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b98a8c1-af97-4119-804c-64e516bc2b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd', 'volume_size': 1, 'image_id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '05b91faa47354f49b9d6a77417353f49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c', 'created_at': datetime.datetime(2026, 9, 21, 14, 28, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 28, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1acd49e3-a6ae-4bfc-ab24-ab8a59d0bc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:50:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23a8a1a-881b-4b20-9d39-187fdfb2b7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:50:11 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Volume volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd (b9fea8a7-96b5-46dc-acff-6912957dbbcd): created successfully Sep 21 16:50:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23a8a1a-881b-4b20-9d39-187fdfb2b7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:50:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Flow 'volume_create_manager' (7bd8cb42-2ea6-4d9a-8335-4734425d61e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:50:11 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5e8c1f9b-ec23-4fe0-90ab-c553641da914 tempest-TestShelveInstance-352272538 None] Created volume successfully. Sep 21 16:50:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-b04c0db4-dc53-4739-97d2-5189c12e676a req-bf4008db-59a3-461e-ab82-8d09ab55c5a5 tempest-TestShelveInstance-352272538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:50:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-b04c0db4-dc53-4739-97d2-5189c12e676a req-bf4008db-59a3-461e-ab82-8d09ab55c5a5 tempest-TestShelveInstance-352272538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:50:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-b04c0db4-dc53-4739-97d2-5189c12e676a req-bf4008db-59a3-461e-ab82-8d09ab55c5a5 tempest-TestShelveInstance-352272538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:50:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-b04c0db4-dc53-4739-97d2-5189c12e676a req-bf4008db-59a3-461e-ab82-8d09ab55c5a5 tempest-TestShelveInstance-352272538 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28d1346b-da3e-4ac1-b7af-aff2300f9087', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:50:15 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-b04c0db4-dc53-4739-97d2-5189c12e676a req-bf4008db-59a3-461e-ab82-8d09ab55c5a5 tempest-TestShelveInstance-352272538 None] attachment_update completed successfully. Sep 21 16:50:25 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=5,cinder:SELECT=16,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:50:25 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=16,cinder:INSERT=9,cinder:UPDATE=7 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:50:44 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-696fd3a1-1051-4f18-b069-a8d7ff24e381 req-7c328a2b-af2d-4199-92a6-d1185d8334da tempest-TestShelveInstance-352272538 None] Terminate volume connection completed successfully. Sep 21 16:50:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-696fd3a1-1051-4f18-b069-a8d7ff24e381 req-7c328a2b-af2d-4199-92a6-d1185d8334da tempest-TestShelveInstance-352272538 None] Deleting attachment 28d1346b-da3e-4ac1-b7af-aff2300f9087. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:50:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-7ea1e246-4da2-40a1-8096-dd4bfddb1e77 req-42ed6072-dce0-4253-bbef-30648eedd029 tempest-TestShelveInstance-352272538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:50:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-7ea1e246-4da2-40a1-8096-dd4bfddb1e77 req-42ed6072-dce0-4253-bbef-30648eedd029 tempest-TestShelveInstance-352272538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:50:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-7ea1e246-4da2-40a1-8096-dd4bfddb1e77 req-42ed6072-dce0-4253-bbef-30648eedd029 tempest-TestShelveInstance-352272538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:50:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-7ea1e246-4da2-40a1-8096-dd4bfddb1e77 req-42ed6072-dce0-4253-bbef-30648eedd029 tempest-TestShelveInstance-352272538 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85eedcef-6b4e-4138-82d6-d4bc905d8010', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:50:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-7ea1e246-4da2-40a1-8096-dd4bfddb1e77 req-42ed6072-dce0-4253-bbef-30648eedd029 tempest-TestShelveInstance-352272538 None] attachment_update completed successfully. Sep 21 16:50:56 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:50:56 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:51:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:51:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:51:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:51:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:51:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:51:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:51:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:51:07 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:51:07 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:51:08 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Sep 21 16:51:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.242s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:51:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:51:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:51:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 29 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:51:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:51:13 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-4fe20935-1232-4ee9-8f86-e90ece1fb2ef tempest-TestShelveInstance-352272538 None] Terminate volume connection completed successfully. Sep 21 16:51:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-4fe20935-1232-4ee9-8f86-e90ece1fb2ef tempest-TestShelveInstance-352272538 None] Deleting attachment 85eedcef-6b4e-4138-82d6-d4bc905d8010. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:51:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Acquiring lock "cinder-b9fea8a7-96b5-46dc-acff-6912957dbbcd-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:51:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Lock "cinder-b9fea8a7-96b5-46dc-acff-6912957dbbcd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:51:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Acquiring lock "cinder-quobyte-b9fea8a7-96b5-46dc-acff-6912957dbbcd" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:51:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Lock "cinder-quobyte-b9fea8a7-96b5-46dc-acff-6912957dbbcd" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:51:13 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b45a21-fbbd-41ed-80e2-e737f742ffe9]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:51:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:51:13 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd Sep 21 16:51:13 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:51:13 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Sep 21 16:51:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd" returned: 0 in 0.377s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:51:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:51:13 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd Sep 21 16:51:13 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:51:13 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Sep 21 16:51:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b9fea8a7-96b5-46dc-acff-6912957dbbcd" returned: 0 in 0.240s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:51:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Lock "cinder-quobyte-b9fea8a7-96b5-46dc-acff-6912957dbbcd" released by "delete_volume" :: held 0.662s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:51:14 devstack cinder-volume[86030]: DEBUG cinder.quota [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Created reservations ['d64987e1-6c98-4aac-ad9e-3a8f54cf3d0a', 'dcb1b54a-63de-4add-aa58-fd6d907cdd4f', '1db41140-fc0f-44cb-8dbc-44039ee47239', '2b5d6b00-d4d3-4b58-a474-bb9f9364f9fd'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:51:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:51:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:51:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:51:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:51:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:51:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:51:14 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:51:14 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:51:14 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Sep 21 16:51:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.260s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:51:14 devstack cinder-volume[86030]: DEBUG cinder.manager [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:51:14 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Deleted volume successfully. Sep 21 16:51:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [req-523305ec-9b15-4c65-b6d8-be568e27f0dc req-7cd1d6b6-ea72-418f-9654-33dfb8ced3a9 tempest-TestShelveInstance-352272538 None] Lock "cinder-b9fea8a7-96b5-46dc-acff-6912957dbbcd-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:51:24 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:51:24 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Flow 'volume_create_manager' (4821466a-235a-45d3-bd5b-e27a69002093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35396ed1-ca21-4ca4-911c-9ac20598f2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35396ed1-ca21-4ca4-911c-9ac20598f2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1713108348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac5ea99-9788-40bb-88d5-093f0bd603de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db344afbaf804c1f834a267f2e9f5549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:51:44Z,use_quota=True,user_id='fb588acad07f433d9f8c6bbfd6b746a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da27a79b-3596-4f48-8f37-0c2927dd853d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da27a79b-3596-4f48-8f37-0c2927dd853d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9bbee0-6fd7-4ffd-899f-aee28e713ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9bbee0-6fd7-4ffd-899f-aee28e713ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac5ea99-9788-40bb-88d5-093f0bd603de', 'volume_name': 'volume-6ac5ea99-9788-40bb-88d5-093f0bd603de', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68aebbc7-01ee-4ef8-aa2d-8cf484e4b0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68aebbc7-01ee-4ef8-aa2d-8cf484e4b0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09593c7a-a34f-4ab7-93c2-60f4e2d01489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:51:44 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Volume 6ac5ea99-9788-40bb-88d5-093f0bd603de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac5ea99-9788-40bb-88d5-093f0bd603de', 'volume_size': 1} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1713108348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac5ea99-9788-40bb-88d5-093f0bd603de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db344afbaf804c1f834a267f2e9f5549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:51:44Z,use_quota=True,user_id='fb588acad07f433d9f8c6bbfd6b746a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Creating volume 6ac5ea99-9788-40bb-88d5-093f0bd603de {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:51:44 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:51:44 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de 1073741824 Sep 21 16:51:44 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:51:44 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de 1073741824" returned: 0 in 0.412s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:51:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:51:44 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de Sep 21 16:51:44 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:51:45 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 21 16:51:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de" returned: 0 in 0.235s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:51:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:51:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:51:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09593c7a-a34f-4ab7-93c2-60f4e2d01489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac5ea99-9788-40bb-88d5-093f0bd603de', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:51:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f167ebd2-f627-4aac-aa63-a35ee9131137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:51:45 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Volume volume-6ac5ea99-9788-40bb-88d5-093f0bd603de (6ac5ea99-9788-40bb-88d5-093f0bd603de): created successfully Sep 21 16:51:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f167ebd2-f627-4aac-aa63-a35ee9131137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:51:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Flow 'volume_create_manager' (4821466a-235a-45d3-bd5b-e27a69002093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:51:45 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6528802b-b840-4583-a15a-7bda2548d095 tempest-TestImageHashVerification-1066347274 None] Created volume successfully. Sep 21 16:51:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:51:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:51:46 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d83ac4d-9e1f-4730-8730-3fa44b97fcbb]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:51:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:51:46 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de Sep 21 16:51:46 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:51:46 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Sep 21 16:51:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de" returned: 0 in 0.360s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:51:46 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[a270571e-1916-4952-b325-933c0f98cabb]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:51:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:51:46 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de Sep 21 16:51:46 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:51:46 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Sep 21 16:51:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de" returned: 0 in 0.359s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:51:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de /opt/stack/data/cinder/conversion/6ac5ea99-9788-40bb-88d5-093f0bd603de.temp_image.f6e68605-acc8-4be9-81d6-d47b4b9a27fclgcm0m5s.img {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:51:46 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de /opt/stack/data/cinder/conversion/6ac5ea99-9788-40bb-88d5-093f0bd603de.temp_image.f6e68605-acc8-4be9-81d6-d47b4b9a27fclgcm0m5s.img Sep 21 16:51:46 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:51:52 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Sep 21 16:51:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de /opt/stack/data/cinder/conversion/6ac5ea99-9788-40bb-88d5-093f0bd603de.temp_image.f6e68605-acc8-4be9-81d6-d47b4b9a27fclgcm0m5s.img" returned: 0 in 5.636s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:51:52 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1829c520-4e25-487a-a5e0-7559d535e05e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:51:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:51:52 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de Sep 21 16:51:52 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:51:53 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 21 16:51:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de" returned: 0 in 0.534s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:51:53 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/conversion/6ac5ea99-9788-40bb-88d5-093f0bd603de.temp_image.f6e68605-acc8-4be9-81d6-d47b4b9a27fclgcm0m5s.img {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:51:53 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] Converted 1024.00 MB image at 181.61 MB/s Sep 21 16:51:53 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] f6e68605-acc8-4be9-81d6-d47b4b9a27fc was raw, no need to convert to raw {{(pid=86030) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 21 16:52:03 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:52:03 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:52:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:52:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:52:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:52:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:52:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:52:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:52:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:52:07 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:52:07 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:52:08 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Sep 21 16:52:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.254s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:52:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:52:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:52:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 29 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:52:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:52:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.702s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:52:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] Uploaded volume to glance image-id: f6e68605-acc8-4be9-81d6-d47b4b9a27fc. {{(pid=86030) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 21 16:52:10 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ee4118e5-5af9-42c0-b070-f27b4f9036a8 tempest-TestImageHashVerification-1066347274 None] Copy volume to image completed successfully. Sep 21 16:52:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Acquiring lock "cinder-6ac5ea99-9788-40bb-88d5-093f0bd603de-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:52:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Lock "cinder-6ac5ea99-9788-40bb-88d5-093f0bd603de-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:52:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Acquiring lock "cinder-quobyte-6ac5ea99-9788-40bb-88d5-093f0bd603de" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:52:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Lock "cinder-quobyte-6ac5ea99-9788-40bb-88d5-093f0bd603de" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:52:11 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eafaf7-6f80-4b93-a6bf-e6903b6d7f6e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:52:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:52:11 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de Sep 21 16:52:11 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:52:12 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de" returned: 0 in 0.382s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:52:12 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de Sep 21 16:52:12 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:52:12 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6ac5ea99-9788-40bb-88d5-093f0bd603de" returned: 0 in 0.266s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Lock "cinder-quobyte-6ac5ea99-9788-40bb-88d5-093f0bd603de" released by "delete_volume" :: held 0.688s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Created reservations ['6b915c41-bf04-40ec-a07d-bfe959e54048', '59de1751-3492-4764-8551-9453c3f99c94', '2be1fcff-397d-4867-803f-47b1cb00d534', 'b14126f8-b6e3-43e7-afd9-e6f31cb1a3c5'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:52:12 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:52:12 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:52:12 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.254s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:52:12 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Deleted volume successfully. Sep 21 16:52:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a7130ebb-fe75-40c9-ae06-6dc022a0e6d2 tempest-TestImageHashVerification-1066347274 None] Lock "cinder-6ac5ea99-9788-40bb-88d5-093f0bd603de-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:52:22 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:52:22 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Flow 'volume_create_manager' (d44ebbea-05a1-4cd1-acd4-c8bc1ea47b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab355471-5a86-4347-a847-bdc3d196a817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab355471-5a86-4347-a847-bdc3d196a817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-21940687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadea138-b97a-47b9-850b-6d2ae898b9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6523841aa34384acc9cad9eef8a18e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:52:44Z,use_quota=True,user_id='56000e2d276d4555958842f64ea999a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca72cbfd-31f3-41ca-b685-bb2c12b9e881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca72cbfd-31f3-41ca-b685-bb2c12b9e881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1831ae9-6bff-498a-bf1f-fbf8e76501f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1831ae9-6bff-498a-bf1f-fbf8e76501f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aadea138-b97a-47b9-850b-6d2ae898b9f0', 'volume_name': 'volume-aadea138-b97a-47b9-850b-6d2ae898b9f0', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d357bd0f-ce58-46b4-a48e-f9b18e13f40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d357bd0f-ce58-46b4-a48e-f9b18e13f40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5370e842-b17f-45e3-8318-a27c7ca3b803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:52:43 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Volume aadea138-b97a-47b9-850b-6d2ae898b9f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aadea138-b97a-47b9-850b-6d2ae898b9f0', 'volume_size': 1} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-21940687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadea138-b97a-47b9-850b-6d2ae898b9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6523841aa34384acc9cad9eef8a18e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:52:44Z,use_quota=True,user_id='56000e2d276d4555958842f64ea999a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Creating volume aadea138-b97a-47b9-850b-6d2ae898b9f0 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:52:43 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:52:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:52:43 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 1073741824 Sep 21 16:52:43 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:52:44 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Sep 21 16:52:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 1073741824" returned: 0 in 0.459s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:52:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:52:44 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 Sep 21 16:52:44 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:52:44 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Sep 21 16:52:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0" returned: 0 in 0.295s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:52:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:52:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:52:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5370e842-b17f-45e3-8318-a27c7ca3b803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aadea138-b97a-47b9-850b-6d2ae898b9f0', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:52:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14a2402-a847-4c2b-9002-1f2389f6a27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:52:44 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Volume volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 (aadea138-b97a-47b9-850b-6d2ae898b9f0): created successfully Sep 21 16:52:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14a2402-a847-4c2b-9002-1f2389f6a27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:52:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Flow 'volume_create_manager' (d44ebbea-05a1-4cd1-acd4-c8bc1ea47b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:52:44 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4776d6a6-432b-430a-8ac4-7d6b994f1784 tempest-TestStampPattern-1904595027 None] Created volume successfully. Sep 21 16:52:56 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:52:56 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:53:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:53:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:53:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:53:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:53:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:53:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:53:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:53:07 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:53:07 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:53:08 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Sep 21 16:53:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.261s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:53:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:53:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:53:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 29 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:53:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:53:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-22270a7e-2fe0-4051-b6a9-2988fe9fed0f req-15e1ac65-4d53-4d7f-8139-eb15952da508 tempest-TestStampPattern-1904595027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:53:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-22270a7e-2fe0-4051-b6a9-2988fe9fed0f req-15e1ac65-4d53-4d7f-8139-eb15952da508 tempest-TestStampPattern-1904595027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:53:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-22270a7e-2fe0-4051-b6a9-2988fe9fed0f req-15e1ac65-4d53-4d7f-8139-eb15952da508 tempest-TestStampPattern-1904595027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:53:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-22270a7e-2fe0-4051-b6a9-2988fe9fed0f req-15e1ac65-4d53-4d7f-8139-eb15952da508 tempest-TestStampPattern-1904595027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-aadea138-b97a-47b9-850b-6d2ae898b9f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c696b3e3-f033-423f-95b9-e53946a4db54', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:53:13 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-22270a7e-2fe0-4051-b6a9-2988fe9fed0f req-15e1ac65-4d53-4d7f-8139-eb15952da508 tempest-TestStampPattern-1904595027 None] attachment_update completed successfully. Sep 21 16:53:17 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-7e83951a-f31e-4427-b134-15690fe914f2 req-46cde884-2cc8-4ab3-95e4-88230488b9b1 tempest-TestStampPattern-1904595027 None] Terminate volume connection completed successfully. Sep 21 16:53:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-7e83951a-f31e-4427-b134-15690fe914f2 req-46cde884-2cc8-4ab3-95e4-88230488b9b1 tempest-TestStampPattern-1904595027 None] Deleting attachment c696b3e3-f033-423f-95b9-e53946a4db54. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:53:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:53:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:53:18 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] Creating offline snapshot 5506eec0-d284-47c3-b710-f2512b785631 of volume aadea138-b97a-47b9-850b-6d2ae898b9f0 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:53:18 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[de208a6a-b5de-481f-9847-88e4649919ed]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:53:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:53:18 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 Sep 21 16:53:18 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:53:18 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 21 16:53:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0" returned: 0 in 0.363s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:53:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:53:18 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 1G Sep 21 16:53:18 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:53:19 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 21 16:53:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 1G" returned: 0 in 0.398s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:53:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:53:19 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 Sep 21 16:53:19 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:53:19 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Sep 21 16:53:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631" returned: 0 in 0.290s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:53:19 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 is being set with open permissions: ugo+rw Sep 21 16:53:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:53:19 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 Sep 21 16:53:19 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:53:19 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Sep 21 16:53:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631" returned: 0 in 0.237s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:53:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:53:19 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.info Sep 21 16:53:19 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:53:19 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Sep 21 16:53:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.info" returned: 0 in 0.249s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:53:19 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.info is being set with open permissions: ugo+rw Sep 21 16:53:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:53:19 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.info Sep 21 16:53:19 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:53:20 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Sep 21 16:53:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.info" returned: 0 in 0.252s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:53:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:53:20 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-92034ca4-45b7-4086-8bb0-8cdd751dba15 tempest-TestStampPattern-1904595027 None] Create snapshot completed successfully Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Flow 'volume_create_manager' (e0fadbfd-8b1e-4ae4-979f-1a54fd640f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6604198-67ba-4d1d-ba79-f3f54985b4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6604198-67ba-4d1d-ba79-f3f54985b4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-648009694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036f6312-5bed-4981-bee1-581ff8656303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6523841aa34384acc9cad9eef8a18e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5506eec0-d284-47c3-b710-f2512b785631,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:53:27Z,use_quota=True,user_id='56000e2d276d4555958842f64ea999a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df361b19-7928-48fb-b750-a15827a068af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df361b19-7928-48fb-b750-a15827a068af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0fece86-00cb-4c24-8041-fc00a10e952a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0fece86-00cb-4c24-8041-fc00a10e952a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '036f6312-5bed-4981-bee1-581ff8656303', 'volume_name': 'volume-036f6312-5bed-4981-bee1-581ff8656303', 'volume_size': 1, 'snapshot_id': '5506eec0-d284-47c3-b710-f2512b785631'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7ce12c-5377-4271-81b3-4df3106db0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7ce12c-5377-4271-81b3-4df3106db0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b5e68c-aab0-4ed9-8289-8d3c49e18d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:53:27 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Volume 036f6312-5bed-4981-bee1-581ff8656303: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-036f6312-5bed-4981-bee1-581ff8656303', 'volume_size': 1, 'snapshot_id': '5506eec0-d284-47c3-b710-f2512b785631'} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Acquiring lock "cinder-quobyte-5506eec0-d284-47c3-b710-f2512b785631-036f6312-5bed-4981-bee1-581ff8656303" by "_create_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Lock "cinder-quobyte-5506eec0-d284-47c3-b710-f2512b785631-036f6312-5bed-4981-bee1-581ff8656303" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Creating volume 036f6312-5bed-4981-bee1-581ff8656303 from snapshot 5506eec0-d284-47c3-b710-f2512b785631 {{(pid=86030) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Acquiring lock "cinder-quobyte-036f6312-5bed-4981-bee1-581ff8656303" by "_copy_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Lock "cinder-quobyte-036f6312-5bed-4981-bee1-581ff8656303" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] snapshot: 5506eec0-d284-47c3-b710-f2512b785631, volume: 036f6312-5bed-4981-bee1-581ff8656303, {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c35283d-34ed-43ac-8140-9b47087b7dcd]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:53:27 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 Sep 21 16:53:27 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:53:27 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631" returned: 0 in 0.409s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aadea138-b97a-47b9-850b-6d2ae898b9f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[908ddff2-f4f7-4cfe-a0ba-e28e6e3d9fce]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:53:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:53:27 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 Sep 21 16:53:27 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:53:28 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Sep 21 16:53:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0" returned: 0 in 0.397s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:53:28 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 16:53:28 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Creating direct copy from snapshot {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 16:53:28 devstack cinder-volume[86030]: DEBUG cinder.utils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Path /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303 not found in is_blk_device check {{(pid=86030) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 21 16:53:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:53:28 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303 Sep 21 16:53:28 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:53:36 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Sep 21 16:53:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303" returned: 0 in 8.886s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:53:36 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0, size 1024.00 MB, duration 8.89 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303 {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:53:36 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Converted 1024.00 MB image at 115.21 MB/s Sep 21 16:53:36 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303 is being set with open permissions: ugo+rw Sep 21 16:53:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:53:36 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303 Sep 21 16:53:36 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:53:37 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:53:37 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:53:37 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Sep 21 16:53:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303" returned: 0 in 0.280s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:53:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Lock "cinder-quobyte-036f6312-5bed-4981-bee1-581ff8656303" released by "_copy_volume_from_snapshot" :: held 10.080s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:53:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Lock "cinder-quobyte-5506eec0-d284-47c3-b710-f2512b785631-036f6312-5bed-4981-bee1-581ff8656303" released by "_create_volume_from_snapshot" :: held 10.171s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:53:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.189s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:53:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b5e68c-aab0-4ed9-8289-8d3c49e18d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036f6312-5bed-4981-bee1-581ff8656303', 'volume_size': 1, 'snapshot_id': '5506eec0-d284-47c3-b710-f2512b785631'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:53:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb6b55d-1586-4098-9538-ad11a0d6c502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:53:37 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Volume volume-036f6312-5bed-4981-bee1-581ff8656303 (036f6312-5bed-4981-bee1-581ff8656303): created successfully Sep 21 16:53:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb6b55d-1586-4098-9538-ad11a0d6c502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:53:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Flow 'volume_create_manager' (e0fadbfd-8b1e-4ae4-979f-1a54fd640f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:53:37 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-9f28f2f9-d2fa-4154-a2f2-9787e9b233e9 tempest-TestStampPattern-1904595027 None] Created volume successfully. Sep 21 16:53:47 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:53:47 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:54:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:54:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:54:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:54:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:54:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:54:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:54:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:07 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:54:07 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:08 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.242s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:54:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:54:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 29 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:54:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:54:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-5bc0de28-a638-461b-8261-4e3844b7967a req-7c8f0ec8-edcc-4d17-8ef8-0b80b90c6aff tempest-TestStampPattern-1904595027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:54:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-5bc0de28-a638-461b-8261-4e3844b7967a req-7c8f0ec8-edcc-4d17-8ef8-0b80b90c6aff tempest-TestStampPattern-1904595027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:54:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [req-5bc0de28-a638-461b-8261-4e3844b7967a req-7c8f0ec8-edcc-4d17-8ef8-0b80b90c6aff tempest-TestStampPattern-1904595027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:54:17 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-5bc0de28-a638-461b-8261-4e3844b7967a req-7c8f0ec8-edcc-4d17-8ef8-0b80b90c6aff tempest-TestStampPattern-1904595027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad', 'name': 'volume-036f6312-5bed-4981-bee1-581ff8656303', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0e84537-b15a-4b00-9a4a-de91c31261b9', 'enforce_multipath': True} {{(pid=86030) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 16:54:17 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-5bc0de28-a638-461b-8261-4e3844b7967a req-7c8f0ec8-edcc-4d17-8ef8-0b80b90c6aff tempest-TestStampPattern-1904595027 None] attachment_update completed successfully. Sep 21 16:54:19 devstack cinder-volume[86030]: INFO cinder.volume.manager [req-77d285fa-db3a-4dfb-8836-a8b8397913ce req-bd9b5ec6-5cc8-44c1-9394-e720589d17d9 tempest-TestStampPattern-1904595027 None] Terminate volume connection completed successfully. Sep 21 16:54:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [req-77d285fa-db3a-4dfb-8836-a8b8397913ce req-bd9b5ec6-5cc8-44c1-9394-e720589d17d9 tempest-TestStampPattern-1904595027 None] Deleting attachment a0e84537-b15a-4b00-9a4a-de91c31261b9. {{(pid=86030) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 16:54:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Acquiring lock "cinder-036f6312-5bed-4981-bee1-581ff8656303-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:54:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Lock "cinder-036f6312-5bed-4981-bee1-581ff8656303-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:54:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Acquiring lock "cinder-quobyte-036f6312-5bed-4981-bee1-581ff8656303" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:54:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Lock "cinder-quobyte-036f6312-5bed-4981-bee1-581ff8656303" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:54:23 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed875f9-4ca5-4eb3-8ce5-446bba2f037f]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:54:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:23 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303 Sep 21 16:54:23 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:23 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303" returned: 0 in 0.354s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:23 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303 Sep 21 16:54:23 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:24 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-036f6312-5bed-4981-bee1-581ff8656303" returned: 0 in 0.236s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Lock "cinder-quobyte-036f6312-5bed-4981-bee1-581ff8656303" released by "delete_volume" :: held 0.631s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Created reservations ['6ee585b0-335c-46d4-8659-a2bd375155d9', 'bd8d7ec9-7101-4ff2-acb4-f748b5127556', 'bf3ffec1-d9b0-40fc-9872-0a5b54cd9728', '4c6cafa0-df2e-4278-b034-093e08efef76'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:24 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:54:24 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:24 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.238s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:54:24 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Deleted volume successfully. Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a5344ded-8be9-43b1-90a2-fddae4ee207e tempest-TestStampPattern-1904595027 None] Lock "cinder-036f6312-5bed-4981-bee1-581ff8656303-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Acquiring lock "cinder-5506eec0-d284-47c3-b710-f2512b785631-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Lock "cinder-5506eec0-d284-47c3-b710-f2512b785631-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Acquiring lock "cinder-quobyte-aadea138-b97a-47b9-850b-6d2ae898b9f0" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Lock "cinder-quobyte-aadea138-b97a-47b9-850b-6d2ae898b9f0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Acquiring lock "cinder-quobyte-5506eec0-d284-47c3-b710-f2512b785631" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Lock "cinder-quobyte-5506eec0-d284-47c3-b710-f2512b785631" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Deleting offline snapshot 5506eec0-d284-47c3-b710-f2512b785631 of volume aadea138-b97a-47b9-850b-6d2ae898b9f0 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] snapshot_file for this snap is: volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9b8960-61cd-43a7-9873-2b207af4d124]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:54:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:24 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 Sep 21 16:54:24 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:25 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631" returned: 0 in 0.361s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aadea138-b97a-47b9-850b-6d2ae898b9f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:54:25 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5824d02-2841-4bfe-a9ea-8b8c9dd2ce4e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:54:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:25 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 Sep 21 16:54:25 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:25 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0" returned: 0 in 0.517s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:25 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 Sep 21 16:54:25 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:26 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631" returned: 0 in 0.321s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:26 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631 Sep 21 16:54:26 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:26 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0.5506eec0-d284-47c3-b710-f2512b785631" returned: 0 in 0.235s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Lock "cinder-quobyte-5506eec0-d284-47c3-b710-f2512b785631" released by "_delete_snapshot" :: held 1.532s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:54:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Lock "cinder-quobyte-aadea138-b97a-47b9-850b-6d2ae898b9f0" released by "delete_snapshot" :: held 1.556s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:54:26 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Created reservations ['f58e0e28-15e9-41e9-bf8b-8aa92babaf95', '5ef0d408-5e1e-4ab2-b2da-ec8d2e92f0b3', '2721cd7e-35d5-46bf-9be5-144dc61d725c', '4ecf7d31-0179-4600-8944-6109bdb05844'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:54:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Delete snapshot completed successfully. Sep 21 16:54:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-86a345e8-5b21-435e-acb3-b02cb32c3ef4 tempest-TestStampPattern-1904595027 None] Lock "cinder-5506eec0-d284-47c3-b710-f2512b785631-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:54:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Acquiring lock "cinder-aadea138-b97a-47b9-850b-6d2ae898b9f0-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:54:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Lock "cinder-aadea138-b97a-47b9-850b-6d2ae898b9f0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:54:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Acquiring lock "cinder-quobyte-aadea138-b97a-47b9-850b-6d2ae898b9f0" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:54:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Lock "cinder-quobyte-aadea138-b97a-47b9-850b-6d2ae898b9f0" acquired by "delete_volume" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:54:30 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe302ca-0042-4446-b419-4d7d83c4944a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:54:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:30 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 Sep 21 16:54:30 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:30 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0" returned: 0 in 0.380s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:30 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0 Sep 21 16:54:30 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:31 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aadea138-b97a-47b9-850b-6d2ae898b9f0" returned: 0 in 0.242s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Lock "cinder-quobyte-aadea138-b97a-47b9-850b-6d2ae898b9f0" released by "delete_volume" :: held 0.681s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:54:31 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Created reservations ['6c9fd256-2e54-4ec9-ab76-18c45d31d2a6', 'bed70846-71c8-441a-a091-da1b58906a8c', '6353021c-713d-4a16-9d55-14fbcbb7cd54', '91f0440d-e76d-4610-a526-012b96db2db0'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:54:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:54:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:54:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:54:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:54:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:54:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:31 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:54:31 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:31 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.240s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:31 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:54:31 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Deleted volume successfully. Sep 21 16:54:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fbdfbee4-a0b7-4f8a-a170-fc1ad93a50a2 tempest-TestStampPattern-1904595027 None] Lock "cinder-aadea138-b97a-47b9-850b-6d2ae898b9f0-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:54:41 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=22,cinder:INSERT=5,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:54:41 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Flow 'volume_create_manager' (a46f5bb9-7d94-49bf-94e4-a6f84ed136ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1826d156-7ac4-453f-8a3f-d04038eb3345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1826d156-7ac4-453f-8a3f-d04038eb3345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e8b40c-61fc-4aab-9dfd-e68fcfd592ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd891ace12d740509ea4fb27f0b29ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:54:45Z,use_quota=True,user_id='0e1b1964309e475ebf06fefd217aeb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0547781a-bc43-42d3-bb05-5b57c94e0ce1),volume_type_id=0547781a-bc43-42d3-bb05-5b57c94e0ce1)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71f26f9-bb50-4125-8c6f-3ccf236f66ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71f26f9-bb50-4125-8c6f-3ccf236f66ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f136e9ae-66ed-4cfc-b83a-ca0656b60241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.image.glance [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Creating Keystone auth plugin from conf {{(pid=86030) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f136e9ae-66ed-4cfc-b83a-ca0656b60241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66e8b40c-61fc-4aab-9dfd-e68fcfd592ef', 'volume_name': 'volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef', 'volume_size': 1, 'image_id': '483cb47e-15af-4cdb-9460-a44c40056e44', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/483cb47e-15af-4cdb-9460-a44c40056e44', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed0f9bb5837780e9d9027e995204091f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fd891ace12d740509ea4fb27f0b29ce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c242a80da136f64fc65a273ca8d73ffd8a144c6da651658685f7c9a2023438d7b3ffe9c912d9cc2634cb23eb62eb131b4d057edc827805154200176b8af6e076', 'id': '483cb47e-15af-4cdb-9460-a44c40056e44', 'created_at': datetime.datetime(2026, 9, 21, 14, 54, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 54, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/483cb47e-15af-4cdb-9460-a44c40056e44/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f32452-10e4-487a-90fe-907f8ba68720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f32452-10e4-487a-90fe-907f8ba68720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68918e7-e1d6-4c52-b384-bb5791303fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:45 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Volume 66e8b40c-61fc-4aab-9dfd-e68fcfd592ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef', 'volume_size': 1, 'image_id': '483cb47e-15af-4cdb-9460-a44c40056e44', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/483cb47e-15af-4cdb-9460-a44c40056e44', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed0f9bb5837780e9d9027e995204091f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fd891ace12d740509ea4fb27f0b29ce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c242a80da136f64fc65a273ca8d73ffd8a144c6da651658685f7c9a2023438d7b3ffe9c912d9cc2634cb23eb62eb131b4d057edc827805154200176b8af6e076', 'id': '483cb47e-15af-4cdb-9460-a44c40056e44', 'created_at': datetime.datetime(2026, 9, 21, 14, 54, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 54, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/483cb47e-15af-4cdb-9460-a44c40056e44/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Trying to clone 66e8b40c-61fc-4aab-9dfd-e68fcfd592ef from image 483cb47e-15af-4cdb-9460-a44c40056e44 at location (None, [{'url': 'file:///opt/stack/data/glance/images/483cb47e-15af-4cdb-9460-a44c40056e44', 'metadata': {}}]). {{(pid=86030) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 16:54:45 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Image download 0.00 MB at 0.00 MB/s Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e0df58-d871-4bda-840b-bec3476a8637]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:54:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:45 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD Sep 21 16:54:45 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:46 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:46 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD Sep 21 16:54:46 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:46 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:54:46 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Temporary image 483cb47e-15af-4cdb-9460-a44c40056e44 is fetched for user 0e1b1964309e475ebf06fefd217aeb59. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 16:54:46 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1452f4ee-c179-4afe-8ab9-3f0d1bb60cd5]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:54:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:46 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD Sep 21 16:54:46 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:46 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:46 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD Sep 21 16:54:46 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:47 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD" returned: 1 in 0.320s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e8b40c-61fc-4aab-9dfd-e68fcfd592ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd891ace12d740509ea4fb27f0b29ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:54:45Z,use_quota=True,user_id='0e1b1964309e475ebf06fefd217aeb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0547781a-bc43-42d3-bb05-5b57c94e0ce1),volume_type_id=0547781a-bc43-42d3-bb05-5b57c94e0ce1)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Creating volume 66e8b40c-61fc-4aab-9dfd-e68fcfd592ef {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:54:47 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:47 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef 1073741824 Sep 21 16:54:47 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:47 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef 1073741824" returned: 0 in 0.410s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:47 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef Sep 21 16:54:47 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:47 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef" returned: 0 in 0.241s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Attempting download of 483cb47e-15af-4cdb-9460-a44c40056e44 ((None, [{'url': 'file:///opt/stack/data/glance/images/483cb47e-15af-4cdb-9460-a44c40056e44', 'metadata': {}}])) to volume 66e8b40c-61fc-4aab-9dfd-e68fcfd592ef. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f68a9a7-bc45-4db5-80dc-2e23d6c1577c]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:54:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_483cb47e-15af-4cdb-9460-a44c40056e44_jdilc7dp {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:48 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_483cb47e-15af-4cdb-9460-a44c40056e44_jdilc7dp Sep 21 16:54:48 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:48 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_483cb47e-15af-4cdb-9460-a44c40056e44_jdilc7dp" returned: 0 in 0.316s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_483cb47e-15af-4cdb-9460-a44c40056e44_jdilc7dp {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:48 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_483cb47e-15af-4cdb-9460-a44c40056e44_jdilc7dp Sep 21 16:54:48 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:48 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_483cb47e-15af-4cdb-9460-a44c40056e44_jdilc7dp" returned: 1 in 0.325s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_483cb47e-15af-4cdb-9460-a44c40056e44_jdilc7dp' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:54:48 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cd598b-0aa8-44ab-bf16-34834c83b1fc]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:54:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:48 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD Sep 21 16:54:48 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:48 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:49 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD Sep 21 16:54:49 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:49 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:54:49 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] 483cb47e-15af-4cdb-9460-a44c40056e44 was raw, converting to qcow2 {{(pid=86030) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 16:54:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:49 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef Sep 21 16:54:49 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:49 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef" returned: 0 in 0.437s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:49 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_483cb47e-15af-4cdb-9460-a44c40056e44_l5nwl6tmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:54:49 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Converted 0.00 MB image at 0.00 MB/s Sep 21 16:54:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:49 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef 1G Sep 21 16:54:49 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:49 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef 1G" returned: 0 in 0.295s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:49 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Downloaded image 483cb47e-15af-4cdb-9460-a44c40056e44 ((None, [{'url': 'file:///opt/stack/data/glance/images/483cb47e-15af-4cdb-9460-a44c40056e44', 'metadata': {}}])) to volume 66e8b40c-61fc-4aab-9dfd-e68fcfd592ef successfully. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 21 16:54:49 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Temporary image 483cb47e-15af-4cdb-9460-a44c40056e44 for user 0e1b1964309e475ebf06fefd217aeb59 is deleted. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 16:54:49 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Marking volume 66e8b40c-61fc-4aab-9dfd-e68fcfd592ef as bootable. {{(pid=86030) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 21 16:54:50 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Copying metadata from image 483cb47e-15af-4cdb-9460-a44c40056e44 to 66e8b40c-61fc-4aab-9dfd-e68fcfd592ef. {{(pid=86030) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 16:54:50 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Creating volume glance metadata for volume 66e8b40c-61fc-4aab-9dfd-e68fcfd592ef backed by image 483cb47e-15af-4cdb-9460-a44c40056e44 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '483cb47e-15af-4cdb-9460-a44c40056e44', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ed0f9bb5837780e9d9027e995204091f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86030) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 16:54:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68918e7-e1d6-4c52-b384-bb5791303fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef', 'volume_size': 1, 'image_id': '483cb47e-15af-4cdb-9460-a44c40056e44', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/483cb47e-15af-4cdb-9460-a44c40056e44', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed0f9bb5837780e9d9027e995204091f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fd891ace12d740509ea4fb27f0b29ce1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c242a80da136f64fc65a273ca8d73ffd8a144c6da651658685f7c9a2023438d7b3ffe9c912d9cc2634cb23eb62eb131b4d057edc827805154200176b8af6e076', 'id': '483cb47e-15af-4cdb-9460-a44c40056e44', 'created_at': datetime.datetime(2026, 9, 21, 14, 54, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 54, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/483cb47e-15af-4cdb-9460-a44c40056e44/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5032f4f2-3a68-4e8b-90fb-8e1a3b7c5302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:50 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Volume volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef (66e8b40c-61fc-4aab-9dfd-e68fcfd592ef): created successfully Sep 21 16:54:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5032f4f2-3a68-4e8b-90fb-8e1a3b7c5302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:50 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Flow 'volume_create_manager' (a46f5bb9-7d94-49bf-94e4-a6f84ed136ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:54:50 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-2ebef822-4aa9-43ff-b4b9-a717d1f55422 tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Created volume successfully. Sep 21 16:54:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Acquiring lock "cinder-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:54:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Lock "cinder-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:54:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Acquiring lock "cinder-quobyte-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:54:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Lock "cinder-quobyte-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef" acquired by "delete_volume" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:54:50 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e8d0cc-a45f-41e4-9111-7d38619aeb22]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:54:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:50 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef Sep 21 16:54:50 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:51 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef" returned: 0 in 0.359s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:51 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef Sep 21 16:54:51 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:51 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef" returned: 0 in 0.242s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Lock "cinder-quobyte-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef" released by "delete_volume" :: held 0.640s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:54:51 devstack cinder-volume[86030]: WARNING cinder.quota [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:54:51 devstack cinder-volume[86030]: WARNING cinder.quota [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Created reservations ['5f7e7111-b198-4156-aa12-261c9b366e4b', 'e3f58aa0-8bdf-46d3-ab7b-a99afbb1d5d9', '03e7ded6-46ee-4e19-b7ce-aade2f8c9341', 'dc4248d4-1b90-4f20-9d90-c85f8b7b2c9c'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:51 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:54:51 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:51 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.256s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:54:51 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Deleted volume successfully. Sep 21 16:54:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-da695d79-4390-4e3b-857e-29577afffc0f tempest-VolumeAndVolumeTypeFromImageTest-1714797308 None] Lock "cinder-66e8b40c-61fc-4aab-9dfd-e68fcfd592ef-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Flow 'volume_create_manager' (cb936abb-f087-428b-9ff6-60b62e800c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120e8b33-7958-456b-ba11-ef66e4c88624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120e8b33-7958-456b-ba11-ef66e4c88624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-211669468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3f073d-561f-429a-a8dd-c66b2c06934d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2598010fdc48e1af97a2551e6afb1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:54:56Z,use_quota=True,user_id='b7a92809c62c44118d12a59c3db937af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436fd6e5-3225-43d9-ab30-4c16537571eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436fd6e5-3225-43d9-ab30-4c16537571eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77dcb2cd-692c-4f0e-aaa7-876e7fcd3670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77dcb2cd-692c-4f0e-aaa7-876e7fcd3670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3f073d-561f-429a-a8dd-c66b2c06934d', 'volume_name': 'volume-3a3f073d-561f-429a-a8dd-c66b2c06934d', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c982167e-ded2-412d-aa8e-f0c99e6b73f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c982167e-ded2-412d-aa8e-f0c99e6b73f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0a6802-3ca0-40da-a6fb-ff0e7ce468a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:55 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Volume 3a3f073d-561f-429a-a8dd-c66b2c06934d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3f073d-561f-429a-a8dd-c66b2c06934d', 'volume_size': 1} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-211669468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3f073d-561f-429a-a8dd-c66b2c06934d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2598010fdc48e1af97a2551e6afb1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:54:56Z,use_quota=True,user_id='b7a92809c62c44118d12a59c3db937af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Creating volume 3a3f073d-561f-429a-a8dd-c66b2c06934d {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:54:55 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:54:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:55 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d 1073741824 Sep 21 16:54:55 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:56 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d 1073741824" returned: 0 in 0.416s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:56 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d Sep 21 16:54:56 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:56 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d" returned: 0 in 0.239s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0a6802-3ca0-40da-a6fb-ff0e7ce468a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3f073d-561f-429a-a8dd-c66b2c06934d', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ed3ac5-7e7c-4b9d-aea2-9578312f9640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:56 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Volume volume-3a3f073d-561f-429a-a8dd-c66b2c06934d (3a3f073d-561f-429a-a8dd-c66b2c06934d): created successfully Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ed3ac5-7e7c-4b9d-aea2-9578312f9640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Flow 'volume_create_manager' (cb936abb-f087-428b-9ff6-60b62e800c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:54:56 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d3d56f0e-f460-4dc2-b2fc-78b1d236dae0 tempest-VolumeDependencyTests-497573195 None] Created volume successfully. Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] Creating offline snapshot e88388c2-3c7f-44c5-afb2-ca782c7dbfde of volume 3a3f073d-561f-429a-a8dd-c66b2c06934d {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f2085e-0736-4b9e-84af-a31dfca84a20]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:54:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:57 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d Sep 21 16:54:57 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:57 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d" returned: 0 in 0.356s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:57 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde 1G Sep 21 16:54:57 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:57 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde 1G" returned: 0 in 0.387s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a3f073d-561f-429a-a8dd-c66b2c06934d -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:57 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a3f073d-561f-429a-a8dd-c66b2c06934d -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde Sep 21 16:54:57 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:57 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a3f073d-561f-429a-a8dd-c66b2c06934d -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde" returned: 0 in 0.290s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:57 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde is being set with open permissions: ugo+rw Sep 21 16:54:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:58 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde Sep 21 16:54:58 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:58 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde" returned: 0 in 0.239s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:58 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.info Sep 21 16:54:58 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:58 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.info" returned: 0 in 0.255s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:58 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.info is being set with open permissions: ugo+rw Sep 21 16:54:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:58 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.info Sep 21 16:54:58 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:54:58 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Sep 21 16:54:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.info" returned: 0 in 0.249s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:54:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:54:58 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-977a6b62-791f-45d8-8873-b75a7fb3ff74 tempest-VolumeDependencyTests-497573195 None] Create snapshot completed successfully Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Flow 'volume_create_manager' (a54313f6-480d-41be-964e-9f2a69dac50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d895e25d-1abe-4184-857b-4e8bab03c33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d895e25d-1abe-4184-857b-4e8bab03c33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1637893703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f798c37-6283-4d9f-9d44-65cc0409f79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2598010fdc48e1af97a2551e6afb1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e88388c2-3c7f-44c5-afb2-ca782c7dbfde,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:54:59Z,use_quota=True,user_id='b7a92809c62c44118d12a59c3db937af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c5be68-504d-49b7-934a-89a4944e29e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c5be68-504d-49b7-934a-89a4944e29e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89e32da-be66-434c-860f-cb6f4fc1dec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89e32da-be66-434c-860f-cb6f4fc1dec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f798c37-6283-4d9f-9d44-65cc0409f79d', 'volume_name': 'volume-2f798c37-6283-4d9f-9d44-65cc0409f79d', 'volume_size': 1, 'snapshot_id': 'e88388c2-3c7f-44c5-afb2-ca782c7dbfde'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e34815-aad3-4ddf-88b4-a8d39bf5140a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e34815-aad3-4ddf-88b4-a8d39bf5140a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9014a356-b800-48cd-9fc2-e6fe668ad68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:54:59 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Volume 2f798c37-6283-4d9f-9d44-65cc0409f79d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f798c37-6283-4d9f-9d44-65cc0409f79d', 'volume_size': 1, 'snapshot_id': 'e88388c2-3c7f-44c5-afb2-ca782c7dbfde'} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "cinder-quobyte-e88388c2-3c7f-44c5-afb2-ca782c7dbfde-2f798c37-6283-4d9f-9d44-65cc0409f79d" by "_create_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-quobyte-e88388c2-3c7f-44c5-afb2-ca782c7dbfde-2f798c37-6283-4d9f-9d44-65cc0409f79d" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Creating volume 2f798c37-6283-4d9f-9d44-65cc0409f79d from snapshot e88388c2-3c7f-44c5-afb2-ca782c7dbfde {{(pid=86030) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "cinder-quobyte-2f798c37-6283-4d9f-9d44-65cc0409f79d" by "_copy_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-quobyte-2f798c37-6283-4d9f-9d44-65cc0409f79d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] snapshot: e88388c2-3c7f-44c5-afb2-ca782c7dbfde, volume: 2f798c37-6283-4d9f-9d44-65cc0409f79d, {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52963b9-8576-4ddc-b1bb-a24b318aa49d]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:54:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:54:59 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde Sep 21 16:54:59 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:00 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde" returned: 0 in 0.355s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a3f073d-561f-429a-a8dd-c66b2c06934d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:55:00 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbe82e8-761a-45c2-880b-f6571aae8c43]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:00 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d Sep 21 16:55:00 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:00 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d" returned: 0 in 0.350s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 16:55:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Creating direct copy from snapshot {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 16:55:00 devstack cinder-volume[86030]: DEBUG cinder.utils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Path /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d not found in is_blk_device check {{(pid=86030) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 21 16:55:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:00 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d Sep 21 16:55:00 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:06 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d" returned: 0 in 6.165s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:06 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:55:06 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Converted 1024.00 MB image at 166.06 MB/s Sep 21 16:55:06 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d is being set with open permissions: ugo+rw Sep 21 16:55:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:06 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d Sep 21 16:55:06 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:06 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d" returned: 0 in 0.243s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-quobyte-2f798c37-6283-4d9f-9d44-65cc0409f79d" released by "_copy_volume_from_snapshot" :: held 7.195s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-quobyte-e88388c2-3c7f-44c5-afb2-ca782c7dbfde-2f798c37-6283-4d9f-9d44-65cc0409f79d" released by "_create_volume_from_snapshot" :: held 7.256s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.270s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9014a356-b800-48cd-9fc2-e6fe668ad68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f798c37-6283-4d9f-9d44-65cc0409f79d', 'volume_size': 1, 'snapshot_id': 'e88388c2-3c7f-44c5-afb2-ca782c7dbfde'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b343ab5e-de92-448b-a8bd-d729b10142dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:06 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Volume volume-2f798c37-6283-4d9f-9d44-65cc0409f79d (2f798c37-6283-4d9f-9d44-65cc0409f79d): created successfully Sep 21 16:55:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b343ab5e-de92-448b-a8bd-d729b10142dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:06 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Flow 'volume_create_manager' (a54313f6-480d-41be-964e-9f2a69dac50e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:55:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6c556371-41c4-4014-b0e1-6ad03c179ab1 tempest-VolumeDependencyTests-497573195 None] Created volume successfully. Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "cinder-e88388c2-3c7f-44c5-afb2-ca782c7dbfde-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-e88388c2-3c7f-44c5-afb2-ca782c7dbfde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "cinder-quobyte-3a3f073d-561f-429a-a8dd-c66b2c06934d" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-quobyte-3a3f073d-561f-429a-a8dd-c66b2c06934d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "cinder-quobyte-e88388c2-3c7f-44c5-afb2-ca782c7dbfde" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-quobyte-e88388c2-3c7f-44c5-afb2-ca782c7dbfde" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Deleting offline snapshot e88388c2-3c7f-44c5-afb2-ca782c7dbfde of volume 3a3f073d-561f-429a-a8dd-c66b2c06934d {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] snapshot_file for this snap is: volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6751de-1bfb-415c-b7ca-79d2e5ad1579]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:07 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde Sep 21 16:55:07 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:07 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde" returned: 0 in 0.359s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a3f073d-561f-429a-a8dd-c66b2c06934d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86bd771-699f-4f22-85f7-87f177188065]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:07 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d Sep 21 16:55:07 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:07 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:55:07 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:08 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d" returned: 0 in 0.543s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:08 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.254s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 29 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:55:08 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde Sep 21 16:55:08 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:08 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde" returned: 0 in 0.323s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:08 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde Sep 21 16:55:08 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:08 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d.e88388c2-3c7f-44c5-afb2-ca782c7dbfde" returned: 0 in 0.239s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-quobyte-e88388c2-3c7f-44c5-afb2-ca782c7dbfde" released by "_delete_snapshot" :: held 1.565s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-quobyte-3a3f073d-561f-429a-a8dd-c66b2c06934d" released by "delete_snapshot" :: held 1.586s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Created reservations ['474437dd-4430-4a54-8f23-1eaf4199f077', 'dc4e964b-a35b-4370-ab43-12a8120118ed', '8c1d926d-f726-45a6-b2e0-b7f75668cd28', 'c0931751-c295-494f-bf19-5ea6bfc40190'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:55:08 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Delete snapshot completed successfully. Sep 21 16:55:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fddfc731-1d85-4cbb-875b-f41f39a6d985 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-e88388c2-3c7f-44c5-afb2-ca782c7dbfde-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "cinder-3a3f073d-561f-429a-a8dd-c66b2c06934d-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-3a3f073d-561f-429a-a8dd-c66b2c06934d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "cinder-quobyte-3a3f073d-561f-429a-a8dd-c66b2c06934d" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-quobyte-3a3f073d-561f-429a-a8dd-c66b2c06934d" acquired by "delete_volume" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:09 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1f498e-a301-4fd4-b912-083f1b88ea85]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:09 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d Sep 21 16:55:09 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:09 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d" returned: 0 in 0.354s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:09 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d Sep 21 16:55:09 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:09 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-3a3f073d-561f-429a-a8dd-c66b2c06934d" returned: 0 in 0.247s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-quobyte-3a3f073d-561f-429a-a8dd-c66b2c06934d" released by "delete_volume" :: held 0.661s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Created reservations ['7636d447-e519-4cea-87f9-60f55281759e', '9cfb4963-922b-4375-8643-bcd2ae0a99cd', '33a36e19-cef3-45d8-873a-7733688b6493', '0aa45010-9c21-4efa-b5e7-14fafe9a7b04'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:10 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:55:10 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:10 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.240s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:55:10 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Deleted volume successfully. Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-43eee6ed-f609-4ac4-b16c-507b284ccd39 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-3a3f073d-561f-429a-a8dd-c66b2c06934d-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "cinder-2f798c37-6283-4d9f-9d44-65cc0409f79d-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-2f798c37-6283-4d9f-9d44-65cc0409f79d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "cinder-quobyte-2f798c37-6283-4d9f-9d44-65cc0409f79d" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-quobyte-2f798c37-6283-4d9f-9d44-65cc0409f79d" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd812dc-e3fd-46d1-bb6c-928882ac1292]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:10 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d Sep 21 16:55:10 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:10 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d" returned: 0 in 0.361s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:10 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d Sep 21 16:55:10 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:11 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2f798c37-6283-4d9f-9d44-65cc0409f79d" returned: 0 in 0.251s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-quobyte-2f798c37-6283-4d9f-9d44-65cc0409f79d" released by "delete_volume" :: held 0.651s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:11 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Created reservations ['272d9b2a-0e4b-4736-b9df-8f85d2431447', 'f39be245-bb31-46b2-b5ea-2f13b52fb4ca', 'bc5f3f20-da5a-41bf-8ea1-de8590c1391c', '1d18b7bb-d4ac-4bc1-b6d4-17aeb7afb93b'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:55:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:55:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:55:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:11 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:55:11 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:11 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.243s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:11 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:55:11 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Deleted volume successfully. Sep 21 16:55:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b51ab9e8-47db-4944-a808-148e605ed0a6 tempest-VolumeDependencyTests-497573195 None] Lock "cinder-2f798c37-6283-4d9f-9d44-65cc0409f79d-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Flow 'volume_create_manager' (306c2c03-5dd0-47c7-bd16-e1cad13e8f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86724c6-a476-427a-8373-f4ea17776776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86724c6-a476-427a-8373-f4ea17776776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0597e53-5d7d-4016-9a69-2e73572c3fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39ed27235e948dd8768655a707c8863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:55:14Z,use_quota=True,user_id='197f37f523864e75a36068c60d876841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c06217-d94c-4bd2-9d3d-af55eceacdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c06217-d94c-4bd2-9d3d-af55eceacdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd3663a-99cb-48d1-aa86-665eff870720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd3663a-99cb-48d1-aa86-665eff870720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0597e53-5d7d-4016-9a69-2e73572c3fb6', 'volume_name': 'volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d799ee2c-d649-4e06-a838-96f16fb035f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d799ee2c-d649-4e06-a838-96f16fb035f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6ec126-8941-4d07-bba8-f699cc6f5278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:14 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Volume e0597e53-5d7d-4016-9a69-2e73572c3fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6', 'volume_size': 1} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0597e53-5d7d-4016-9a69-2e73572c3fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39ed27235e948dd8768655a707c8863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:55:14Z,use_quota=True,user_id='197f37f523864e75a36068c60d876841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Creating volume e0597e53-5d7d-4016-9a69-2e73572c3fb6 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:55:14 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:14 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6 1073741824 Sep 21 16:55:14 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:14 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6 1073741824" returned: 0 in 0.405s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:14 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6 Sep 21 16:55:14 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:15 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6" returned: 0 in 0.250s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6ec126-8941-4d07-bba8-f699cc6f5278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fbcb98-36a9-450e-b292-b47b17f7313f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:15 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Volume volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6 (e0597e53-5d7d-4016-9a69-2e73572c3fb6): created successfully Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fbcb98-36a9-450e-b292-b47b17f7313f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Flow 'volume_create_manager' (306c2c03-5dd0-47c7-bd16-e1cad13e8f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:55:15 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-f3ee390e-4c54-4e6e-8396-7bb4b4711cd5 tempest-CinderUnicodeTest-720374869 None] Created volume successfully. Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Flow 'volume_create_manager' (f7fe7fbb-b579-4625-b86a-34443bf3a873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7be73a-fe35-4d1c-86a8-de2a3be53f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7be73a-fe35-4d1c-86a8-de2a3be53f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:55:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1614151873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eface69-812d-4bd4-9201-a647ceb8266f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39ed27235e948dd8768655a707c8863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:55:16Z,use_quota=True,user_id='197f37f523864e75a36068c60d876841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5009fe9-1626-4a22-8336-1fe335eafd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5009fe9-1626-4a22-8336-1fe335eafd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2748403b-937c-4552-8835-0fe5964d3628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2748403b-937c-4552-8835-0fe5964d3628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eface69-812d-4bd4-9201-a647ceb8266f', 'volume_name': 'volume-6eface69-812d-4bd4-9201-a647ceb8266f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bedc5da-337e-4bd7-a90a-5ecb0c42bd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bedc5da-337e-4bd7-a90a-5ecb0c42bd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5106d949-4099-4c5d-aa78-e613c02186b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:15 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Volume 6eface69-812d-4bd4-9201-a647ceb8266f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eface69-812d-4bd4-9201-a647ceb8266f', 'volume_size': 1} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:55:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1614151873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eface69-812d-4bd4-9201-a647ceb8266f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39ed27235e948dd8768655a707c8863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:55:16Z,use_quota=True,user_id='197f37f523864e75a36068c60d876841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Creating volume 6eface69-812d-4bd4-9201-a647ceb8266f {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:55:15 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:55:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:15 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f 1073741824 Sep 21 16:55:15 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:16 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f 1073741824" returned: 0 in 0.409s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:16 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f Sep 21 16:55:16 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:16 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f" returned: 0 in 0.247s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:55:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5106d949-4099-4c5d-aa78-e613c02186b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eface69-812d-4bd4-9201-a647ceb8266f', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b45fc30-ea0d-465c-aab4-c489ace37527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:16 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Volume volume-6eface69-812d-4bd4-9201-a647ceb8266f (6eface69-812d-4bd4-9201-a647ceb8266f): created successfully Sep 21 16:55:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b45fc30-ea0d-465c-aab4-c489ace37527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Flow 'volume_create_manager' (f7fe7fbb-b579-4625-b86a-34443bf3a873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:55:16 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-9a01bea9-392a-4f02-b060-48da92c6a5d4 tempest-CinderUnicodeTest-720374869 None] Created volume successfully. Sep 21 16:55:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] Creating offline snapshot c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b of volume 6eface69-812d-4bd4-9201-a647ceb8266f {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:55:17 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b371dc7-b26f-479f-a5bd-fd3868e19edf]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:17 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f Sep 21 16:55:17 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:17 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f" returned: 0 in 0.367s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:17 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b 1G Sep 21 16:55:17 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:17 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b 1G" returned: 0 in 0.402s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eface69-812d-4bd4-9201-a647ceb8266f -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:17 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eface69-812d-4bd4-9201-a647ceb8266f -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b Sep 21 16:55:17 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:18 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eface69-812d-4bd4-9201-a647ceb8266f -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b" returned: 0 in 0.285s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:18 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b is being set with open permissions: ugo+rw Sep 21 16:55:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:18 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b Sep 21 16:55:18 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:18 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b" returned: 0 in 0.250s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:18 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.info Sep 21 16:55:18 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:18 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.info" returned: 0 in 0.258s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:18 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.info is being set with open permissions: ugo+rw Sep 21 16:55:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:18 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.info Sep 21 16:55:18 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:18 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.info" returned: 0 in 0.246s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:18 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4677f7c2-de69-455c-969c-d83f9cfbaa0b tempest-CinderUnicodeTest-720374869 None] Create snapshot completed successfully Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Acquiring lock "cinder-c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Lock "cinder-c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Acquiring lock "cinder-quobyte-6eface69-812d-4bd4-9201-a647ceb8266f" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Lock "cinder-quobyte-6eface69-812d-4bd4-9201-a647ceb8266f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Acquiring lock "cinder-quobyte-c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Lock "cinder-quobyte-c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Deleting offline snapshot c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b of volume 6eface69-812d-4bd4-9201-a647ceb8266f {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] snapshot_file for this snap is: volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[923ee491-6bea-45b4-b0a7-3697a491a090]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:19 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b Sep 21 16:55:19 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:19 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b" returned: 0 in 0.373s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eface69-812d-4bd4-9201-a647ceb8266f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f9dddb-8984-46ae-8b3e-a1f346c9e5ac]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:19 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f Sep 21 16:55:19 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:20 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f" returned: 0 in 0.369s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:20 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b Sep 21 16:55:20 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:20 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b" returned: 0 in 0.346s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:20 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b Sep 21 16:55:20 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:20 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f.c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b" returned: 0 in 0.251s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Lock "cinder-quobyte-c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b" released by "_delete_snapshot" :: held 1.449s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Lock "cinder-quobyte-6eface69-812d-4bd4-9201-a647ceb8266f" released by "delete_snapshot" :: held 1.473s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:20 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Created reservations ['b445c34b-adff-47c5-b384-8bb199ffb771', 'acb89fc7-83c2-4935-a6e5-5463802e2a47', '32900fc3-e467-47ab-bdfc-90498725df62', '87368685-2a08-4464-bfc5-dc5314986523'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:55:21 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Delete snapshot completed successfully. Sep 21 16:55:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-224b6eee-daa7-48b0-89ea-07883f53efb1 tempest-CinderUnicodeTest-720374869 None] Lock "cinder-c59df3d5-c6d8-46b7-b3ce-4ce5ade9472b-delete_snapshot" released by "delete_snapshot" :: held 1.615s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Acquiring lock "cinder-6eface69-812d-4bd4-9201-a647ceb8266f-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Lock "cinder-6eface69-812d-4bd4-9201-a647ceb8266f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Acquiring lock "cinder-quobyte-6eface69-812d-4bd4-9201-a647ceb8266f" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Lock "cinder-quobyte-6eface69-812d-4bd4-9201-a647ceb8266f" acquired by "delete_volume" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:21 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79ade0d-d37f-4bae-ad32-4bc01ab92d9b]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:21 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f Sep 21 16:55:21 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:22 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f" returned: 0 in 0.356s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:22 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f Sep 21 16:55:22 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:22 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6eface69-812d-4bd4-9201-a647ceb8266f" returned: 0 in 0.267s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Lock "cinder-quobyte-6eface69-812d-4bd4-9201-a647ceb8266f" released by "delete_volume" :: held 0.694s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Created reservations ['67e02a06-c004-4a49-b36a-4ef00a0c40ae', '545c6a2e-3f28-4e5f-92b8-9bf5812914a3', 'ffd4fc5b-3613-411e-a86f-caa1c6fbefdd', '659d3bc4-8392-4277-8964-fdeebc56aaf9'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:22 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:55:22 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:22 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.264s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:55:22 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Deleted volume successfully. Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Acquiring lock "cinder-e0597e53-5d7d-4016-9a69-2e73572c3fb6-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5a7bd3e3-1291-4939-94f3-543d26584c80 tempest-CinderUnicodeTest-720374869 None] Lock "cinder-6eface69-812d-4bd4-9201-a647ceb8266f-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Lock "cinder-e0597e53-5d7d-4016-9a69-2e73572c3fb6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Acquiring lock "cinder-quobyte-e0597e53-5d7d-4016-9a69-2e73572c3fb6" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Lock "cinder-quobyte-e0597e53-5d7d-4016-9a69-2e73572c3fb6" acquired by "delete_volume" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9491b85-ba02-4b2d-a627-2047ef17614c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:22 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6 Sep 21 16:55:22 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:23 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6" returned: 0 in 0.361s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:23 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6 Sep 21 16:55:23 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:23 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0597e53-5d7d-4016-9a69-2e73572c3fb6" returned: 0 in 0.250s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Lock "cinder-quobyte-e0597e53-5d7d-4016-9a69-2e73572c3fb6" released by "delete_volume" :: held 0.658s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Created reservations ['40917970-f62e-4be6-b729-b29553df3b0d', '52833334-5a76-4b1b-88e0-e75e9d2812a6', '3d2834fc-68b9-4986-a3bf-64ab6301bfd1', 'dc693e53-71b3-4000-bc47-2f28188a8068'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:23 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:55:23 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:23 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.261s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:55:23 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Deleted volume successfully. Sep 21 16:55:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-1dee81d2-0154-4e6a-8050-27f6f25c94ac tempest-CinderUnicodeTest-720374869 None] Lock "cinder-e0597e53-5d7d-4016-9a69-2e73572c3fb6-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:33 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=79,cinder:SELECT=58,cinder:INSERT=20,cinder:DELETE=6 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:55:33 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=64,cinder:INSERT=25,cinder:UPDATE=63,cinder:DELETE=6 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Flow 'volume_create_manager' (aef59794-ac1d-4557-9743-9ea27c381559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2a8d65-a351-42fc-b46d-16bfd3b9fc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2a8d65-a351-42fc-b46d-16bfd3b9fc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1956373265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bb1e21-b520-4977-b609-ceebaa1afda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccac50b1303647488ad3392bae614f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:55:44Z,use_quota=True,user_id='83240361c9c542b9a0a2472c827f448d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e90e914-d59b-49cb-ac59-73ac8f661552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e90e914-d59b-49cb-ac59-73ac8f661552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86fd743-c44a-48cd-8dd5-91b2231cc0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86fd743-c44a-48cd-8dd5-91b2231cc0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94bb1e21-b520-4977-b609-ceebaa1afda8', 'volume_name': 'volume-94bb1e21-b520-4977-b609-ceebaa1afda8', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22559eaf-3f85-4857-8b9d-0569bfd25de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22559eaf-3f85-4857-8b9d-0569bfd25de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c9a2dd-eaed-4b8b-a058-3784ffc0bde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:43 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Volume 94bb1e21-b520-4977-b609-ceebaa1afda8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94bb1e21-b520-4977-b609-ceebaa1afda8', 'volume_size': 1} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1956373265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bb1e21-b520-4977-b609-ceebaa1afda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccac50b1303647488ad3392bae614f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:55:44Z,use_quota=True,user_id='83240361c9c542b9a0a2472c827f448d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Creating volume 94bb1e21-b520-4977-b609-ceebaa1afda8 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:55:43 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:55:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:43 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 1073741824 Sep 21 16:55:43 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:44 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 1073741824" returned: 0 in 0.415s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:44 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 Sep 21 16:55:44 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:44 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8" returned: 0 in 0.246s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c9a2dd-eaed-4b8b-a058-3784ffc0bde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94bb1e21-b520-4977-b609-ceebaa1afda8', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3550aea4-5a59-4518-bf2e-51c61eec2be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:44 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Volume volume-94bb1e21-b520-4977-b609-ceebaa1afda8 (94bb1e21-b520-4977-b609-ceebaa1afda8): created successfully Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3550aea4-5a59-4518-bf2e-51c61eec2be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Flow 'volume_create_manager' (aef59794-ac1d-4557-9743-9ea27c381559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:55:44 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-f7397845-7de9-4a65-aff0-4b0186c4acc3 tempest-SnapshotDependencyTests-1312577412 None] Created volume successfully. Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] Creating offline snapshot 48b4809e-2e41-4658-bad8-be6d8ff11b4b of volume 94bb1e21-b520-4977-b609-ceebaa1afda8 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2614d2a6-2c6b-4963-9f2d-c5a09d75a52c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:44 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 Sep 21 16:55:45 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:45 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8" returned: 0 in 0.354s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:45 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b 1G Sep 21 16:55:45 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:45 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b 1G" returned: 0 in 0.394s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bb1e21-b520-4977-b609-ceebaa1afda8 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:45 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bb1e21-b520-4977-b609-ceebaa1afda8 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b Sep 21 16:55:45 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:45 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94bb1e21-b520-4977-b609-ceebaa1afda8 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b" returned: 0 in 0.287s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:45 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b is being set with open permissions: ugo+rw Sep 21 16:55:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:45 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b Sep 21 16:55:45 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:46 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b" returned: 0 in 0.247s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:46 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.info Sep 21 16:55:46 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:46 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.info" returned: 0 in 0.249s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:46 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.info is being set with open permissions: ugo+rw Sep 21 16:55:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:46 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.info Sep 21 16:55:46 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:46 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.info" returned: 0 in 0.250s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8df1442b-9af5-411b-b9fa-b950d15e9bd2 tempest-SnapshotDependencyTests-1312577412 None] Create snapshot completed successfully Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Flow 'volume_create_manager' (52e8d501-4f36-47c9-97b8-7f7d2496fd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfd5abd-ac4a-4279-8b40-86eaf87a7802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfd5abd-ac4a-4279-8b40-86eaf87a7802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e240e17-c28f-48c5-9c74-b8c81f712b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccac50b1303647488ad3392bae614f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=48b4809e-2e41-4658-bad8-be6d8ff11b4b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:55:47Z,use_quota=True,user_id='83240361c9c542b9a0a2472c827f448d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16296dc4-d5cd-4550-89b0-eb2e3543f1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16296dc4-d5cd-4550-89b0-eb2e3543f1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9848872-e058-4689-ad04-e83c721ea453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9848872-e058-4689-ad04-e83c721ea453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1e240e17-c28f-48c5-9c74-b8c81f712b8b', 'volume_name': 'volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b', 'volume_size': 1, 'snapshot_id': '48b4809e-2e41-4658-bad8-be6d8ff11b4b'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f1325b-1750-4d73-b63c-28f2b7fe624a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f1325b-1750-4d73-b63c-28f2b7fe624a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d726444-3d9a-4040-9888-133892b5180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:47 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Volume 1e240e17-c28f-48c5-9c74-b8c81f712b8b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b', 'volume_size': 1, 'snapshot_id': '48b4809e-2e41-4658-bad8-be6d8ff11b4b'} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "cinder-quobyte-48b4809e-2e41-4658-bad8-be6d8ff11b4b-1e240e17-c28f-48c5-9c74-b8c81f712b8b" by "_create_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-quobyte-48b4809e-2e41-4658-bad8-be6d8ff11b4b-1e240e17-c28f-48c5-9c74-b8c81f712b8b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Creating volume 1e240e17-c28f-48c5-9c74-b8c81f712b8b from snapshot 48b4809e-2e41-4658-bad8-be6d8ff11b4b {{(pid=86030) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "cinder-quobyte-1e240e17-c28f-48c5-9c74-b8c81f712b8b" by "_copy_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-quobyte-1e240e17-c28f-48c5-9c74-b8c81f712b8b" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] snapshot: 48b4809e-2e41-4658-bad8-be6d8ff11b4b, volume: 1e240e17-c28f-48c5-9c74-b8c81f712b8b, {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[563f5511-6400-4063-99ec-4cc1741c1fd5]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:47 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b Sep 21 16:55:47 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:48 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b" returned: 0 in 0.352s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94bb1e21-b520-4977-b609-ceebaa1afda8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:55:48 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f87fe8-a7d7-4b39-a745-b3c5611a8f0e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:48 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 Sep 21 16:55:48 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:48 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8" returned: 0 in 0.362s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 16:55:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Creating direct copy from snapshot {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 16:55:48 devstack cinder-volume[86030]: DEBUG cinder.utils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Path /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b not found in is_blk_device check {{(pid=86030) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 21 16:55:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:48 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b Sep 21 16:55:48 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:54 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b" returned: 0 in 5.910s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:54 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:55:54 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Converted 1024.00 MB image at 173.22 MB/s Sep 21 16:55:54 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b is being set with open permissions: ugo+rw Sep 21 16:55:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:54 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b Sep 21 16:55:54 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:54 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b" returned: 0 in 0.235s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-quobyte-1e240e17-c28f-48c5-9c74-b8c81f712b8b" released by "_copy_volume_from_snapshot" :: held 6.945s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-quobyte-48b4809e-2e41-4658-bad8-be6d8ff11b4b-1e240e17-c28f-48c5-9c74-b8c81f712b8b" released by "_create_volume_from_snapshot" :: held 7.006s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.022s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d726444-3d9a-4040-9888-133892b5180d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b', 'volume_size': 1, 'snapshot_id': '48b4809e-2e41-4658-bad8-be6d8ff11b4b'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414fafd6-b74b-4833-b8d9-54d7a8a2328e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:55:54 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Volume volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b (1e240e17-c28f-48c5-9c74-b8c81f712b8b): created successfully Sep 21 16:55:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414fafd6-b74b-4833-b8d9-54d7a8a2328e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:55:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Flow 'volume_create_manager' (52e8d501-4f36-47c9-97b8-7f7d2496fd16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:55:54 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5b4bc00f-b405-4f8c-818f-9f962db1cc3c tempest-SnapshotDependencyTests-1312577412 None] Created volume successfully. Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "cinder-48b4809e-2e41-4658-bad8-be6d8ff11b4b-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-48b4809e-2e41-4658-bad8-be6d8ff11b4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "cinder-quobyte-94bb1e21-b520-4977-b609-ceebaa1afda8" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-quobyte-94bb1e21-b520-4977-b609-ceebaa1afda8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "cinder-quobyte-48b4809e-2e41-4658-bad8-be6d8ff11b4b" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-quobyte-48b4809e-2e41-4658-bad8-be6d8ff11b4b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Deleting offline snapshot 48b4809e-2e41-4658-bad8-be6d8ff11b4b of volume 94bb1e21-b520-4977-b609-ceebaa1afda8 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] snapshot_file for this snap is: volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6def3c73-3c47-4f0e-952a-32a572fdd1cb]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:55 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b Sep 21 16:55:55 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:55 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b" returned: 0 in 0.350s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94bb1e21-b520-4977-b609-ceebaa1afda8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1137b83f-0d2c-4ad3-8788-b3a7f06afb7e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:55 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 Sep 21 16:55:55 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:56 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8" returned: 0 in 0.519s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:56 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b Sep 21 16:55:56 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:56 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b" returned: 0 in 0.316s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:56 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b Sep 21 16:55:56 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:56 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8.48b4809e-2e41-4658-bad8-be6d8ff11b4b" returned: 0 in 0.241s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:56 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-quobyte-48b4809e-2e41-4658-bad8-be6d8ff11b4b" released by "_delete_snapshot" :: held 1.531s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:56 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-quobyte-94bb1e21-b520-4977-b609-ceebaa1afda8" released by "delete_snapshot" :: held 1.551s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:56 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Created reservations ['9e29eca1-2de3-432d-adf8-11234f139506', '25d77181-0bf1-4ed6-93f3-e2f3d3d4d7a9', '768f0a6a-efe3-4108-a9b8-9af284c85061', '1c43977b-cfa0-4067-8594-314c2d36032b'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:55:56 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Delete snapshot completed successfully. Sep 21 16:55:56 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-431c367b-3dfd-4bee-b834-78b7c7bde61c tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-48b4809e-2e41-4658-bad8-be6d8ff11b4b-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "cinder-94bb1e21-b520-4977-b609-ceebaa1afda8-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-94bb1e21-b520-4977-b609-ceebaa1afda8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "cinder-quobyte-94bb1e21-b520-4977-b609-ceebaa1afda8" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-quobyte-94bb1e21-b520-4977-b609-ceebaa1afda8" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:57 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[34702d55-8d3f-4e9a-b432-90ad80c5d930]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:57 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 Sep 21 16:55:57 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:57 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8" returned: 0 in 0.352s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:57 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8 Sep 21 16:55:57 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:57 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-94bb1e21-b520-4977-b609-ceebaa1afda8" returned: 0 in 0.248s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:57 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-quobyte-94bb1e21-b520-4977-b609-ceebaa1afda8" released by "delete_volume" :: held 0.656s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Created reservations ['7cb9ef75-6e01-4811-aa86-2d8d951f5df9', '98d30660-96cc-434c-9ddb-e04f526feca7', 'b650b64b-9e94-4cbb-b48b-df82862b5e79', '2d23b34d-c27f-49d5-b8f9-5a95084438b3'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:58 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:55:58 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:58 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.238s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:55:58 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Deleted volume successfully. Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3e96da82-20c7-4138-bfa6-56c3dc45c119 tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-94bb1e21-b520-4977-b609-ceebaa1afda8-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "cinder-1e240e17-c28f-48c5-9c74-b8c81f712b8b-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-1e240e17-c28f-48c5-9c74-b8c81f712b8b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "cinder-quobyte-1e240e17-c28f-48c5-9c74-b8c81f712b8b" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-quobyte-1e240e17-c28f-48c5-9c74-b8c81f712b8b" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[79db85a9-afb3-47dd-ad74-7b92d2871bd2]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:58 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b Sep 21 16:55:58 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:58 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b" returned: 0 in 0.359s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:58 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b Sep 21 16:55:58 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:59 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-1e240e17-c28f-48c5-9c74-b8c81f712b8b" returned: 0 in 0.237s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-quobyte-1e240e17-c28f-48c5-9c74-b8c81f712b8b" released by "delete_volume" :: held 0.635s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:55:59 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Created reservations ['4df3ba51-6893-4c9e-a391-ceface4ec0f0', 'c10cafc0-bb9b-4fae-b76c-5cc281f25a66', 'fede5eb3-c363-4cbe-bd6f-0a538b4ae7bc', '566a60d8-fda0-40f3-bb79-33f829779522'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:55:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:55:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:55:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:55:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:55:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:55:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:55:59 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:55:59 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:55:59 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 21 16:55:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.241s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:55:59 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:55:59 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Deleted volume successfully. Sep 21 16:55:59 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-247f33f2-12ff-4309-9817-41488d0d9f17 tempest-SnapshotDependencyTests-1312577412 None] Lock "cinder-1e240e17-c28f-48c5-9c74-b8c81f712b8b-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:56:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:07 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:07 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:08 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.266s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:56:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 29 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:56:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:56:09 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=24,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:56:09 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Flow 'volume_create_manager' (62f7ee87-1333-4efa-b10c-d6e6e0b160f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca572507-f9c6-421c-ad10-c5302423f216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca572507-f9c6-421c-ad10-c5302423f216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1731112676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf9b686-69e0-497d-87d3-72172d33f217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6518834058344489a4104e50178d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:20Z,use_quota=True,user_id='7763c0509f3c4cc4b42de34c1957a593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ea7be1-88b6-48dd-8077-44be2be6d3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ea7be1-88b6-48dd-8077-44be2be6d3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f6c908-4059-4cce-9544-3bf2e1e5d0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f6c908-4059-4cce-9544-3bf2e1e5d0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaf9b686-69e0-497d-87d3-72172d33f217', 'volume_name': 'volume-aaf9b686-69e0-497d-87d3-72172d33f217', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdeaa1e-8cb1-4701-9442-69de9d3567d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdeaa1e-8cb1-4701-9442-69de9d3567d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (343814f2-3a75-4fb0-9c2b-68e07d005fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Volume aaf9b686-69e0-497d-87d3-72172d33f217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaf9b686-69e0-497d-87d3-72172d33f217', 'volume_size': 1} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1731112676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf9b686-69e0-497d-87d3-72172d33f217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6518834058344489a4104e50178d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:20Z,use_quota=True,user_id='7763c0509f3c4cc4b42de34c1957a593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Creating volume aaf9b686-69e0-497d-87d3-72172d33f217 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:20 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aaf9b686-69e0-497d-87d3-72172d33f217 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:20 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aaf9b686-69e0-497d-87d3-72172d33f217 1073741824 Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:20 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Flow 'volume_create_manager' (9aaa1263-6846-4402-8151-b1553582f5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c75469-e25a-4d40-93b0-0b26786ae74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c75469-e25a-4d40-93b0-0b26786ae74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1676223800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4333767e-8954-46ec-bf68-cc3a4b25eb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00273f721ee2463795449a925a0322d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:20Z,use_quota=True,user_id='4e5c491a8a1948519bf752be17629d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74d0f17-1d75-4412-a338-8d40efc0552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74d0f17-1d75-4412-a338-8d40efc0552f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670c1ed7-3785-4767-97cb-16feaecd0d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670c1ed7-3785-4767-97cb-16feaecd0d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4333767e-8954-46ec-bf68-cc3a4b25eb85', 'volume_name': 'volume-4333767e-8954-46ec-bf68-cc3a4b25eb85', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85e2193-8ed6-4d58-b117-528ec8222602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85e2193-8ed6-4d58-b117-528ec8222602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b13588-6c5e-41f7-a356-baa0a7d0cda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Volume 4333767e-8954-46ec-bf68-cc3a4b25eb85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4333767e-8954-46ec-bf68-cc3a4b25eb85', 'volume_size': 1} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Flow 'volume_create_manager' (2307c261-3a58-4d6f-a009-6f5a27e7d948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f078d29d-2bd0-481b-bb49-1dbcab68ac28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f078d29d-2bd0-481b-bb49-1dbcab68ac28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1156240384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2305f2-4c6d-4afd-8eec-c07064f69d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6518834058344489a4104e50178d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:21Z,use_quota=True,user_id='7763c0509f3c4cc4b42de34c1957a593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651d136c-9bfd-4651-8f71-58ae4a3b4935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651d136c-9bfd-4651-8f71-58ae4a3b4935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff52a39-7105-44ef-b782-da8189ffe046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff52a39-7105-44ef-b782-da8189ffe046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e2305f2-4c6d-4afd-8eec-c07064f69d20', 'volume_name': 'volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34868ccf-13b2-4824-a668-e4cef22b18f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34868ccf-13b2-4824-a668-e4cef22b18f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f4940d-e1dd-4c6d-9560-3c13bebf59b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:20 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Volume 0e2305f2-4c6d-4afd-8eec-c07064f69d20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20', 'volume_size': 1} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:20 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Flow 'volume_create_manager' (84353cc3-7dcb-4393-977c-d043d797d1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31f1b3a-5ed8-4038-8f5a-9a50fc845880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31f1b3a-5ed8-4038-8f5a-9a50fc845880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1777599092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9abf8415-5c1a-41c4-a460-c1ea6caa67d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314463f54e5f4535bb95ed285ab721da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:21Z,use_quota=True,user_id='c8188241ba194838bdcb8a311305212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63b4692-92aa-49d4-b376-b25315ecbd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63b4692-92aa-49d4-b376-b25315ecbd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a57fa78-9d52-4cbd-a67c-658e440de971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a57fa78-9d52-4cbd-a67c-658e440de971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9abf8415-5c1a-41c4-a460-c1ea6caa67d4', 'volume_name': 'volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696f590f-e375-4d34-ba30-79a243e830c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696f590f-e375-4d34-ba30-79a243e830c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec51946d-edd4-4752-aeac-504c121ccaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume 9abf8415-5c1a-41c4-a460-c1ea6caa67d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4', 'volume_size': 1} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:21 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aaf9b686-69e0-497d-87d3-72172d33f217 1073741824" returned: 0 in 0.742s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aaf9b686-69e0-497d-87d3-72172d33f217 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:21 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aaf9b686-69e0-497d-87d3-72172d33f217 Sep 21 16:56:21 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Flow 'volume_create_manager' (37cc15c5-812c-455e-be57-3eb9dc3187f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f02b3c-208d-4762-bdc8-4e2e21df67de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f02b3c-208d-4762-bdc8-4e2e21df67de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-578859794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef272bf-0c90-4176-bc10-88ab51e37fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6518834058344489a4104e50178d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:21Z,use_quota=True,user_id='7763c0509f3c4cc4b42de34c1957a593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a2e1d7-d58c-489e-93cd-c6be423d97ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a2e1d7-d58c-489e-93cd-c6be423d97ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e721a71f-39eb-469f-8141-edf9addd17e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e721a71f-39eb-469f-8141-edf9addd17e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef272bf-0c90-4176-bc10-88ab51e37fc9', 'volume_name': 'volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2870093b-e2fc-4c19-a39d-5c3f1baaed5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2870093b-e2fc-4c19-a39d-5c3f1baaed5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f62656-cb00-4faf-8a5b-a6ee31ccaa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Volume 2ef272bf-0c90-4176-bc10-88ab51e37fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9', 'volume_size': 1} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:21 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aaf9b686-69e0-497d-87d3-72172d33f217" returned: 0 in 0.308s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.836s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1676223800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4333767e-8954-46ec-bf68-cc3a4b25eb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00273f721ee2463795449a925a0322d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:20Z,use_quota=True,user_id='4e5c491a8a1948519bf752be17629d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Creating volume 4333767e-8954-46ec-bf68-cc3a4b25eb85 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:21 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (343814f2-3a75-4fb0-9c2b-68e07d005fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaf9b686-69e0-497d-87d3-72172d33f217', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 1073741824 Sep 21 16:56:21 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282d99f7-d3c3-4a62-ba0d-2d1d2a3f85f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Volume volume-aaf9b686-69e0-497d-87d3-72172d33f217 (aaf9b686-69e0-497d-87d3-72172d33f217): created successfully Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282d99f7-d3c3-4a62-ba0d-2d1d2a3f85f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Flow 'volume_create_manager' (62f7ee87-1333-4efa-b10c-d6e6e0b160f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Flow 'volume_create_manager' (bf819e79-d31d-420d-9dcf-376e70b8d82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3c08a1-3c5c-4678-bd84-da7237b2351c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8edd82c4-190c-48de-9c55-d6411be1f506 tempest-CreateVolumesFromImageTest-52621790 None] Created volume successfully. Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3c08a1-3c5c-4678-bd84-da7237b2351c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-723232263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6f3d4d-6b97-41f0-9025-fa906ff140de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6518834058344489a4104e50178d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:22Z,use_quota=True,user_id='7763c0509f3c4cc4b42de34c1957a593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7080ad-6f6e-422c-b66e-0972f068d09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7080ad-6f6e-422c-b66e-0972f068d09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d65f05b-8979-4ffa-ab82-5482125654f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d65f05b-8979-4ffa-ab82-5482125654f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c6f3d4d-6b97-41f0-9025-fa906ff140de', 'volume_name': 'volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00ab7a3-9ef7-456a-8209-1c8b9ee8f6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00ab7a3-9ef7-456a-8209-1c8b9ee8f6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5b100b-121b-4cdd-be2a-cdf1f8bb7f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:21 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Volume 5c6f3d4d-6b97-41f0-9025-fa906ff140de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de', 'volume_size': 1} Sep 21 16:56:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Flow 'volume_create_manager' (7fad979e-aa66-4e58-9e24-0244203df532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9394c84-6a9b-4f93-9816-91eb763b4c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:22 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 1073741824" returned: 0 in 0.650s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9394c84-6a9b-4f93-9816-91eb763b4c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-855077837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c231372-7071-4d73-a0aa-c32ca43a2633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6518834058344489a4104e50178d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:22Z,use_quota=True,user_id='7763c0509f3c4cc4b42de34c1957a593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2026673a-a4dd-4632-8d39-958b9a17aecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2026673a-a4dd-4632-8d39-958b9a17aecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd28a3de-830b-456b-bbdb-183977901a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd28a3de-830b-456b-bbdb-183977901a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c231372-7071-4d73-a0aa-c32ca43a2633', 'volume_name': 'volume-7c231372-7071-4d73-a0aa-c32ca43a2633', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46648e32-9901-4b67-9940-ac1e3f5f6d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46648e32-9901-4b67-9940-ac1e3f5f6d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1162201c-15df-41ba-be17-47eb53400125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:22 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Volume 7c231372-7071-4d73-a0aa-c32ca43a2633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c231372-7071-4d73-a0aa-c32ca43a2633', 'volume_size': 1} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:22 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 Sep 21 16:56:22 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:22 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85" returned: 0 in 0.252s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.721s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1156240384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2305f2-4c6d-4afd-8eec-c07064f69d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6518834058344489a4104e50178d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:21Z,use_quota=True,user_id='7763c0509f3c4cc4b42de34c1957a593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Creating volume 0e2305f2-4c6d-4afd-8eec-c07064f69d20 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:22 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:22 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20 1073741824 Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b13588-6c5e-41f7-a356-baa0a7d0cda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4333767e-8954-46ec-bf68-cc3a4b25eb85', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:22 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bb180a-d19c-4194-8b7e-f34d089a24e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:22 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Volume volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 (4333767e-8954-46ec-bf68-cc3a4b25eb85): created successfully Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bb180a-d19c-4194-8b7e-f34d089a24e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Flow 'volume_create_manager' (9aaa1263-6846-4402-8151-b1553582f5b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:22 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-110aee04-547a-467e-97d6-7140210da795 tempest-VolumeDependencyTests-161761153 None] Created volume successfully. Sep 21 16:56:23 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20 1073741824" returned: 0 in 0.479s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:23 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20 Sep 21 16:56:23 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:23 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20" returned: 0 in 0.315s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.301s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1777599092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9abf8415-5c1a-41c4-a460-c1ea6caa67d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314463f54e5f4535bb95ed285ab721da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:21Z,use_quota=True,user_id='c8188241ba194838bdcb8a311305212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Creating volume 9abf8415-5c1a-41c4-a460-c1ea6caa67d4 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:23 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f4940d-e1dd-4c6d-9560-3c13bebf59b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:23 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4 1073741824 Sep 21 16:56:23 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15085f7f-458b-4705-9aae-448dea8c57e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:23 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Volume volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20 (0e2305f2-4c6d-4afd-8eec-c07064f69d20): created successfully Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15085f7f-458b-4705-9aae-448dea8c57e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Flow 'volume_create_manager' (2307c261-3a58-4d6f-a009-6f5a27e7d948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:23 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d4ed6152-9643-4377-9a3a-a378778be4d0 tempest-CreateVolumesFromImageTest-52621790 None] Created volume successfully. Sep 21 16:56:23 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4 1073741824" returned: 0 in 0.443s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:23 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4 Sep 21 16:56:23 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:24 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4" returned: 0 in 0.259s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.735s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-578859794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef272bf-0c90-4176-bc10-88ab51e37fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6518834058344489a4104e50178d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:21Z,use_quota=True,user_id='7763c0509f3c4cc4b42de34c1957a593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Creating volume 2ef272bf-0c90-4176-bc10-88ab51e37fc9 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:24 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:24 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9 1073741824 Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec51946d-edd4-4752-aeac-504c121ccaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:24 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c135181-82a1-44cb-93d5-3f263c20dfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:24 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4 (9abf8415-5c1a-41c4-a460-c1ea6caa67d4): created successfully Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c135181-82a1-44cb-93d5-3f263c20dfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Flow 'volume_create_manager' (84353cc3-7dcb-4393-977c-d043d797d1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:24 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-095dc693-f08b-439c-946e-e13c3905db61 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Created volume successfully. Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Flow 'volume_create_manager' (78fd2483-a601-45f6-b25e-26ed477f13a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc7c5f6-efb4-404e-b5b3-7387aeddaf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc7c5f6-efb4-404e-b5b3-7387aeddaf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a810fd20-8953-4033-8d07-bfdf7f65d7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a110acfc6df64605b3d3cfb54f23972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:24Z,use_quota=True,user_id='5c944daf15b84c31810b243f191a74f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af2c641a-810a-4e45-ac3b-cacb5042f2e8),volume_type_id=af2c641a-810a-4e45-ac3b-cacb5042f2e8)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aca043e-6c86-4722-b9c9-fbeac3d737aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aca043e-6c86-4722-b9c9-fbeac3d737aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a631ae-c740-4145-9774-e050eeedab43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.image.glance [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Creating Keystone auth plugin from conf {{(pid=86030) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a631ae-c740-4145-9774-e050eeedab43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a810fd20-8953-4033-8d07-bfdf7f65d7a6', 'volume_name': 'volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6', 'volume_size': 1, 'image_id': 'b76cda9c-4527-4ea4-a256-58819dc83afb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b76cda9c-4527-4ea4-a256-58819dc83afb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ddc6d24aee8a8a9edb508956a380425b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a110acfc6df64605b3d3cfb54f23972e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b2f13e58d41b5317ad94da503ab0eb0424cfa63d27e9a8e44035e3da5d69a287584861b9781413b04e5dfbdaf754d86914ab76c8107f003166fd824838ba08e', 'id': 'b76cda9c-4527-4ea4-a256-58819dc83afb', 'created_at': datetime.datetime(2026, 9, 21, 14, 56, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b76cda9c-4527-4ea4-a256-58819dc83afb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:24 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbc3bc6-89ea-418c-86ae-094ca73c086c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbc3bc6-89ea-418c-86ae-094ca73c086c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443dda45-f931-4005-a234-4b6411a5cf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:24 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Volume a810fd20-8953-4033-8d07-bfdf7f65d7a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6', 'volume_size': 1, 'image_id': 'b76cda9c-4527-4ea4-a256-58819dc83afb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b76cda9c-4527-4ea4-a256-58819dc83afb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ddc6d24aee8a8a9edb508956a380425b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a110acfc6df64605b3d3cfb54f23972e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b2f13e58d41b5317ad94da503ab0eb0424cfa63d27e9a8e44035e3da5d69a287584861b9781413b04e5dfbdaf754d86914ab76c8107f003166fd824838ba08e', 'id': 'b76cda9c-4527-4ea4-a256-58819dc83afb', 'created_at': datetime.datetime(2026, 9, 21, 14, 56, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b76cda9c-4527-4ea4-a256-58819dc83afb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Trying to clone a810fd20-8953-4033-8d07-bfdf7f65d7a6 from image b76cda9c-4527-4ea4-a256-58819dc83afb at location (None, [{'url': 'file:///opt/stack/data/glance/images/b76cda9c-4527-4ea4-a256-58819dc83afb', 'metadata': {}}]). {{(pid=86030) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9 1073741824" returned: 0 in 0.533s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:24 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9 Sep 21 16:56:24 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 16:56:24 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Image download 0.00 MB at 0.00 MB/s Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[73279c92-c0d7-409c-8a96-9ad1fc23c669]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:24 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD Sep 21 16:56:24 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:25 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9" returned: 0 in 0.263s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.199s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-723232263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6f3d4d-6b97-41f0-9025-fa906ff140de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6518834058344489a4104e50178d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:22Z,use_quota=True,user_id='7763c0509f3c4cc4b42de34c1957a593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Creating volume 5c6f3d4d-6b97-41f0-9025-fa906ff140de {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:25 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f62656-cb00-4faf-8a5b-a6ee31ccaa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:25 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de 1073741824 Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d438a7-f64b-4e7c-8ff2-368beaafbd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:25 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:25 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Volume volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9 (2ef272bf-0c90-4176-bc10-88ab51e37fc9): created successfully Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d438a7-f64b-4e7c-8ff2-368beaafbd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Flow 'volume_create_manager' (37cc15c5-812c-455e-be57-3eb9dc3187f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:25 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ddfc3120-363d-4acf-89f7-4162913e342a tempest-CreateVolumesFromImageTest-52621790 None] Created volume successfully. Sep 21 16:56:25 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:25 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD Sep 21 16:56:25 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:25 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de 1073741824" returned: 0 in 0.524s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:25 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:25 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de Sep 21 16:56:25 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD" returned: 1 in 0.470s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Temporary image b76cda9c-4527-4ea4-a256-58819dc83afb is fetched for user 5c944daf15b84c31810b243f191a74f9. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Flow 'volume_create_manager' (a23ea2ae-adfe-44f2-8b0b-48bec8a67c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462e002c-0adc-40a6-9ee7-492d8aadebd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462e002c-0adc-40a6-9ee7-492d8aadebd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095447971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4036b611-6117-466e-9fa5-90bf94663d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314463f54e5f4535bb95ed285ab721da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:26Z,use_quota=True,user_id='c8188241ba194838bdcb8a311305212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa86d6e-7ffd-402b-aa11-e1d96c0c8aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa86d6e-7ffd-402b-aa11-e1d96c0c8aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71641b0f-856a-44fe-99ea-c4b9ddbe8fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71641b0f-856a-44fe-99ea-c4b9ddbe8fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4036b611-6117-466e-9fa5-90bf94663d9e', 'volume_name': 'volume-4036b611-6117-466e-9fa5-90bf94663d9e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65965ac7-3f9c-4acc-9c92-39f010008a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65965ac7-3f9c-4acc-9c92-39f010008a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd3f2bb-bf9c-4942-b2c1-c4e3499bb5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:25 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume 4036b611-6117-466e-9fa5-90bf94663d9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4036b611-6117-466e-9fa5-90bf94663d9e', 'volume_size': 1} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9669f05f-500a-44da-84cd-5293f4454741]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:25 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de" returned: 0 in 0.291s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.624s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-855077837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c231372-7071-4d73-a0aa-c32ca43a2633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6518834058344489a4104e50178d482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:22Z,use_quota=True,user_id='7763c0509f3c4cc4b42de34c1957a593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Creating volume 7c231372-7071-4d73-a0aa-c32ca43a2633 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:25 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c231372-7071-4d73-a0aa-c32ca43a2633 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:25 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD Sep 21 16:56:25 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5b100b-121b-4cdd-be2a-cdf1f8bb7f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e2b3e0-f6ae-4311-8ce1-44eeef0dac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:26 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c231372-7071-4d73-a0aa-c32ca43a2633 1073741824 Sep 21 16:56:26 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:26 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Volume volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de (5c6f3d4d-6b97-41f0-9025-fa906ff140de): created successfully Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e2b3e0-f6ae-4311-8ce1-44eeef0dac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Flow 'volume_create_manager' (bf819e79-d31d-420d-9dcf-376e70b8d82f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-18f4c982-1ac0-477f-ba8b-a8c157036acd tempest-CreateVolumesFromImageTest-52621790 None] Created volume successfully. Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Flow 'volume_create_manager' (54a7e979-ba74-4711-a3c7-7edd9671e557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0302cff-edbe-457c-9b11-125d8b5586c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0302cff-edbe-457c-9b11-125d8b5586c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1916214966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b002cec7-67ad-4cb3-9eed-9e3b3ced1237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314463f54e5f4535bb95ed285ab721da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:26Z,use_quota=True,user_id='c8188241ba194838bdcb8a311305212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12fdc11-cf6b-4403-be23-4813a4b438f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b12fdc11-cf6b-4403-be23-4813a4b438f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b1488a-9090-4291-a56d-6e34c6b9df51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b1488a-9090-4291-a56d-6e34c6b9df51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b002cec7-67ad-4cb3-9eed-9e3b3ced1237', 'volume_name': 'volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3739bf-4ddc-4314-ba62-ba04aa65d173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3739bf-4ddc-4314-ba62-ba04aa65d173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16e2572-c0fc-4a71-b4cc-4f1e4c3de520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:26 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume b002cec7-67ad-4cb3-9eed-9e3b3ced1237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237', 'volume_size': 1} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:26 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:26 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD Sep 21 16:56:26 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Flow 'volume_create_manager' (d26ed201-d628-4c42-b468-68fb10acb94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08baf3eb-23a0-4d99-9252-1356951484db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08baf3eb-23a0-4d99-9252-1356951484db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-495164472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314463f54e5f4535bb95ed285ab721da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:26Z,use_quota=True,user_id='c8188241ba194838bdcb8a311305212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2e933e-7b3d-446a-b204-7371dea4a8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2e933e-7b3d-446a-b204-7371dea4a8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d059d01-b1ea-48cc-9b4b-73ac5b4cd313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d059d01-b1ea-48cc-9b4b-73ac5b4cd313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5', 'volume_name': 'volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a81bff5-7240-4408-bbc3-c3ac12510007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:26 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a81bff5-7240-4408-bbc3-c3ac12510007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff49e7b4-3ab2-430e-844d-411fc78a3e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:26 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume 74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5', 'volume_size': 1} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c231372-7071-4d73-a0aa-c32ca43a2633 1073741824" returned: 0 in 0.610s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c231372-7071-4d73-a0aa-c32ca43a2633 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:26 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c231372-7071-4d73-a0aa-c32ca43a2633 Sep 21 16:56:26 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:26 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD" returned: 1 in 0.423s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:26 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c231372-7071-4d73-a0aa-c32ca43a2633" returned: 0 in 0.328s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.469s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Flow 'volume_create_manager' (f33e02fc-dca8-47d3-b67a-1bb75903387d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6eb9086-4744-44b5-be21-0aa8c82d1d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1162201c-15df-41ba-be17-47eb53400125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c231372-7071-4d73-a0aa-c32ca43a2633', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bb2340-1986-4508-ba7b-ef2b0e77b995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] Creating offline snapshot f22bb3b4-635c-417c-b61e-10900ea88105 of volume 4333767e-8954-46ec-bf68-cc3a4b25eb85 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6eb9086-4744-44b5-be21-0aa8c82d1d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-427152627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8102cb-c0c3-4623-aa58-02eb85cef4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314463f54e5f4535bb95ed285ab721da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:27Z,use_quota=True,user_id='c8188241ba194838bdcb8a311305212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe843a1-7077-40a0-8405-ddce283353ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe843a1-7077-40a0-8405-ddce283353ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feece83b-369d-45e0-a462-5c9071cad130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feece83b-369d-45e0-a462-5c9071cad130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c8102cb-c0c3-4623-aa58-02eb85cef4f3', 'volume_name': 'volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd8850f-9ffa-4ed5-9380-3999baeb3b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd8850f-9ffa-4ed5-9380-3999baeb3b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64388fff-dfe7-4a22-9487-b70fa8e53202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:27 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume 7c8102cb-c0c3-4623-aa58-02eb85cef4f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3', 'volume_size': 1} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[06796d5c-9d52-4c9a-8e3d-ff407d4b91a0]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:27 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Volume volume-7c231372-7071-4d73-a0aa-c32ca43a2633 (7c231372-7071-4d73-a0aa-c32ca43a2633): created successfully Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bb2340-1986-4508-ba7b-ef2b0e77b995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Flow 'volume_create_manager' (7fad979e-aa66-4e58-9e24-0244203df532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:27 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-88c5a378-f5d8-4b62-ab41-46e507f88d6f tempest-CreateVolumesFromImageTest-52621790 None] Created volume successfully. Sep 21 16:56:27 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 Sep 21 16:56:27 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Flow 'volume_create_manager' (df419687-daca-4be5-810e-0ec820fe870a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d3c63a-b83b-4714-8643-6e023f32ecda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d3c63a-b83b-4714-8643-6e023f32ecda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1606193741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8486036f-8da7-417a-9824-4f681f3dba25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314463f54e5f4535bb95ed285ab721da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:27Z,use_quota=True,user_id='c8188241ba194838bdcb8a311305212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4065062-2949-4cea-bfab-c1c4154e4068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4065062-2949-4cea-bfab-c1c4154e4068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598eb057-2834-487f-a8f8-4fa2760284db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598eb057-2834-487f-a8f8-4fa2760284db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8486036f-8da7-417a-9824-4f681f3dba25', 'volume_name': 'volume-8486036f-8da7-417a-9824-4f681f3dba25', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e813efe-7aea-4004-b912-8d0f82ae89c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e813efe-7aea-4004-b912-8d0f82ae89c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930c5fb8-4ead-403e-aed2-17b77b6f96a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:27 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume 8486036f-8da7-417a-9824-4f681f3dba25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8486036f-8da7-417a-9824-4f681f3dba25', 'volume_size': 1} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:27 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85" returned: 0 in 0.364s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:27 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 1G Sep 21 16:56:27 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:27 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 1G" returned: 0 in 0.405s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:27 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 Sep 21 16:56:27 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "cinder-7c231372-7071-4d73-a0aa-c32ca43a2633-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-7c231372-7071-4d73-a0aa-c32ca43a2633-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "cinder-quobyte-7c231372-7071-4d73-a0aa-c32ca43a2633" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-quobyte-7c231372-7071-4d73-a0aa-c32ca43a2633" acquired by "delete_volume" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a01ba7-8c11-4b77-9077-6d6d65244d9e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c231372-7071-4d73-a0aa-c32ca43a2633 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:28 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c231372-7071-4d73-a0aa-c32ca43a2633 Sep 21 16:56:28 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:28 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105" returned: 0 in 0.323s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:28 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 is being set with open permissions: ugo+rw Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:28 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 Sep 21 16:56:28 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:28 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c231372-7071-4d73-a0aa-c32ca43a2633" returned: 0 in 0.396s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c231372-7071-4d73-a0aa-c32ca43a2633 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:28 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c231372-7071-4d73-a0aa-c32ca43a2633 Sep 21 16:56:28 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:28 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105" returned: 0 in 0.292s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:28 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.info Sep 21 16:56:28 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:28 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c231372-7071-4d73-a0aa-c32ca43a2633" returned: 0 in 0.290s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-quobyte-7c231372-7071-4d73-a0aa-c32ca43a2633" released by "delete_volume" :: held 0.735s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Created reservations ['68137734-13e8-4e5e-9971-a4f5a17304f0', '6915cab1-e28c-4465-a0ed-d1c9dd4b7233', '4fa358f4-60c4-4470-9326-99912cea6155', 'b75fe5ab-9f86-46c1-91b4-34fa3ed8cc79'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:28 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.info" returned: 0 in 0.307s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:28 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.info is being set with open permissions: ugo+rw Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:28 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.info Sep 21 16:56:28 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:28 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:28 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "cinder-5c6f3d4d-6b97-41f0-9025-fa906ff140de-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:29 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.info" returned: 0 in 0.287s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-5c6f3d4d-6b97-41f0-9025-fa906ff140de-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.307s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095447971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4036b611-6117-466e-9fa5-90bf94663d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314463f54e5f4535bb95ed285ab721da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:26Z,use_quota=True,user_id='c8188241ba194838bdcb8a311305212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Creating volume 4036b611-6117-466e-9fa5-90bf94663d9e {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:29 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4036b611-6117-466e-9fa5-90bf94663d9e 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:29 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.286s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:29 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4036b611-6117-466e-9fa5-90bf94663d9e 1073741824 Sep 21 16:56:29 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:29 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Deleted volume successfully. Sep 21 16:56:29 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b53582d5-fb91-41ac-bfd2-0f12d8a37d23 tempest-VolumeDependencyTests-161761153 None] Create snapshot completed successfully Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "cinder-quobyte-5c6f3d4d-6b97-41f0-9025-fa906ff140de" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-319dd16e-b0f9-4f14-b155-e4db1e143a26 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-7c231372-7071-4d73-a0aa-c32ca43a2633-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-quobyte-5c6f3d4d-6b97-41f0-9025-fa906ff140de" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[623c5a4c-3e44-4eec-a59e-d97fdd577368]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:29 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de Sep 21 16:56:29 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:29 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4036b611-6117-466e-9fa5-90bf94663d9e 1073741824" returned: 0 in 0.502s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4036b611-6117-466e-9fa5-90bf94663d9e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:29 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de" returned: 0 in 0.437s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:29 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4036b611-6117-466e-9fa5-90bf94663d9e Sep 21 16:56:29 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:29 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de Sep 21 16:56:29 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:29 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4036b611-6117-466e-9fa5-90bf94663d9e" returned: 0 in 0.277s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.761s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1916214966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b002cec7-67ad-4cb3-9eed-9e3b3ced1237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314463f54e5f4535bb95ed285ab721da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:26Z,use_quota=True,user_id='c8188241ba194838bdcb8a311305212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Creating volume b002cec7-67ad-4cb3-9eed-9e3b3ced1237 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:29 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:29 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-5c6f3d4d-6b97-41f0-9025-fa906ff140de" returned: 0 in 0.294s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:29 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237 1073741824 Sep 21 16:56:29 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd3f2bb-bf9c-4942-b2c1-c4e3499bb5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4036b611-6117-466e-9fa5-90bf94663d9e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b140341-2534-4d2a-a5ac-2e647c36ccab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-quobyte-5c6f3d4d-6b97-41f0-9025-fa906ff140de" released by "delete_volume" :: held 0.800s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:30 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume volume-4036b611-6117-466e-9fa5-90bf94663d9e (4036b611-6117-466e-9fa5-90bf94663d9e): created successfully Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b140341-2534-4d2a-a5ac-2e647c36ccab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Flow 'volume_create_manager' (a23ea2ae-adfe-44f2-8b0b-48bec8a67c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:30 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-48d3895f-02b4-4f99-b4b4-983e94bc0f49 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Created volume successfully. Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Created reservations ['627f4802-dd5c-4e42-b085-8bffce218776', 'b76a4d69-6494-45dd-88dc-dcf80947d36b', '74bcc533-35af-4ed4-91cf-4ae32993b65b', '4fdb92f4-be0f-4a0d-be56-5bce5e920a44'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:30 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:30 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "cinder-2ef272bf-0c90-4176-bc10-88ab51e37fc9-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-2ef272bf-0c90-4176-bc10-88ab51e37fc9-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "cinder-quobyte-2ef272bf-0c90-4176-bc10-88ab51e37fc9" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-quobyte-2ef272bf-0c90-4176-bc10-88ab51e37fc9" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2bbbba-a667-45fa-a568-93d7817e81e5]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:30 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.369s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:30 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Deleted volume successfully. Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Flow 'volume_create_manager' (d4dd1956-74b0-4a57-81a0-5b8d31254fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f6585f-e5ba-4129-ad4f-919ca2cd23d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:30 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237 1073741824" returned: 0 in 0.697s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:30 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9 Sep 21 16:56:30 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f6585f-e5ba-4129-ad4f-919ca2cd23d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1885387513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=799a1808-e59c-4d2c-b6a8-ff1e234f67e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00273f721ee2463795449a925a0322d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f22bb3b4-635c-417c-b61e-10900ea88105,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:30Z,use_quota=True,user_id='4e5c491a8a1948519bf752be17629d6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898de226-9646-4cd5-be31-7bf68426dfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898de226-9646-4cd5-be31-7bf68426dfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1946bad-db4f-445e-b3ed-b4b11b96d44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1946bad-db4f-445e-b3ed-b4b11b96d44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '799a1808-e59c-4d2c-b6a8-ff1e234f67e9', 'volume_name': 'volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9', 'volume_size': 1, 'snapshot_id': 'f22bb3b4-635c-417c-b61e-10900ea88105'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416dbb1d-eb0d-4665-97c3-32e0fde01c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416dbb1d-eb0d-4665-97c3-32e0fde01c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a849817-b757-4de5-8a97-52267e99d189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:30 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Volume 799a1808-e59c-4d2c-b6a8-ff1e234f67e9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9', 'volume_size': 1, 'snapshot_id': 'f22bb3b4-635c-417c-b61e-10900ea88105'} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7f16b4a4-495f-42b5-9049-cb0c915c76b2 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-5c6f3d4d-6b97-41f0-9025-fa906ff140de-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:30 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237 Sep 21 16:56:30 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:30 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9" returned: 0 in 0.495s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:30 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9 Sep 21 16:56:30 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:31 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237" returned: 0 in 0.273s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.484s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-495164472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314463f54e5f4535bb95ed285ab721da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:26Z,use_quota=True,user_id='c8188241ba194838bdcb8a311305212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Creating volume 74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:31 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16e2572-c0fc-4a71-b4cc-4f1e4c3de520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81285d62-7e9e-4a90-be69-d9d0874ddb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:31 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5 1073741824 Sep 21 16:56:31 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:31 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237 (b002cec7-67ad-4cb3-9eed-9e3b3ced1237): created successfully Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81285d62-7e9e-4a90-be69-d9d0874ddb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Flow 'volume_create_manager' (54a7e979-ba74-4711-a3c7-7edd9671e557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:31 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-44b536be-4a11-4f8a-9549-df3d1120af9d tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Created volume successfully. Sep 21 16:56:31 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-2ef272bf-0c90-4176-bc10-88ab51e37fc9" returned: 0 in 0.261s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-quobyte-2ef272bf-0c90-4176-bc10-88ab51e37fc9" released by "delete_volume" :: held 0.820s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Created reservations ['3b79fb3d-046a-4d34-b93e-eefd5badbd21', '4b0c2508-de82-4801-b5ea-0af58301edcc', 'f60cafb6-5f40-4ef2-85e6-8ce7b35cd3a4', '1e1e026d-8c6b-4578-a993-3cb0e98c461e'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:31 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:31 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "cinder-0e2305f2-4c6d-4afd-8eec-c07064f69d20-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-0e2305f2-4c6d-4afd-8eec-c07064f69d20-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "cinder-quobyte-0e2305f2-4c6d-4afd-8eec-c07064f69d20" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-quobyte-0e2305f2-4c6d-4afd-8eec-c07064f69d20" acquired by "delete_volume" :: waited 0.032s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d9b591-f9bf-45f0-911f-c4c32ec6c524]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:31 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5 1073741824" returned: 0 in 0.582s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:31 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.338s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:31 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Deleted volume successfully. Sep 21 16:56:31 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5 Sep 21 16:56:31 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-aa0832ba-038d-400f-be01-496c637e4a8e tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-2ef272bf-0c90-4176-bc10-88ab51e37fc9-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:31 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20 Sep 21 16:56:31 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:31 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5" returned: 0 in 0.267s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.282s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a810fd20-8953-4033-8d07-bfdf7f65d7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a110acfc6df64605b3d3cfb54f23972e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:24Z,use_quota=True,user_id='5c944daf15b84c31810b243f191a74f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af2c641a-810a-4e45-ac3b-cacb5042f2e8),volume_type_id=af2c641a-810a-4e45-ac3b-cacb5042f2e8)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Creating volume a810fd20-8953-4033-8d07-bfdf7f65d7a6 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:31 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff49e7b4-3ab2-430e-844d-411fc78a3e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86b0041-0310-474d-9cc0-1bc764505d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:32 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 1073741824 Sep 21 16:56:32 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:32 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5 (74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5): created successfully Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86b0041-0310-474d-9cc0-1bc764505d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Flow 'volume_create_manager' (d26ed201-d628-4c42-b468-68fb10acb94e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:32 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3f700416-1303-41dc-9fee-e519108c618f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Created volume successfully. Sep 21 16:56:32 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20" returned: 0 in 0.458s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:32 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20 Sep 21 16:56:32 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:32 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-0e2305f2-4c6d-4afd-8eec-c07064f69d20" returned: 0 in 0.296s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-quobyte-0e2305f2-4c6d-4afd-8eec-c07064f69d20" released by "delete_volume" :: held 0.813s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:32 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Created reservations ['59c4a9ac-a881-469a-a221-24c15806485f', '4c30862f-55ef-4e75-9ece-3df19a47ee35', '5b502dc3-02cd-47e0-a4b9-8b3c058cbad0', '3221ff73-344b-47ae-af19-03a667f1dcb5'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 1073741824" returned: 0 in 0.470s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:32 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 Sep 21 16:56:32 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:32 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:32 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "cinder-aaf9b686-69e0-497d-87d3-72172d33f217-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-aaf9b686-69e0-497d-87d3-72172d33f217-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "cinder-quobyte-aaf9b686-69e0-497d-87d3-72172d33f217" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:32 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6" returned: 0 in 0.316s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.778s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-427152627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8102cb-c0c3-4623-aa58-02eb85cef4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314463f54e5f4535bb95ed285ab721da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:27Z,use_quota=True,user_id='c8188241ba194838bdcb8a311305212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Creating volume 7c8102cb-c0c3-4623-aa58-02eb85cef4f3 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:32 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-quobyte-aaf9b686-69e0-497d-87d3-72172d33f217" acquired by "delete_volume" :: waited 0.080s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:32 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3 1073741824 Sep 21 16:56:32 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faaa0ff-a68d-430c-a33f-b3362643a2b3]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aaf9b686-69e0-497d-87d3-72172d33f217 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Attempting download of b76cda9c-4527-4ea4-a256-58819dc83afb ((None, [{'url': 'file:///opt/stack/data/glance/images/b76cda9c-4527-4ea4-a256-58819dc83afb', 'metadata': {}}])) to volume a810fd20-8953-4033-8d07-bfdf7f65d7a6. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 21 16:56:32 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.388s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:32 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Deleted volume successfully. Sep 21 16:56:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-be9dff0e-37f5-4392-a1a5-2f8482ade9c7 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-0e2305f2-4c6d-4afd-8eec-c07064f69d20-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8dac4a-19e8-4ac9-91d6-a79e8c14fccf]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b76cda9c-4527-4ea4-a256-58819dc83afb_v48u3_z7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:33 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aaf9b686-69e0-497d-87d3-72172d33f217 Sep 21 16:56:33 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:33 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b76cda9c-4527-4ea4-a256-58819dc83afb_v48u3_z7 Sep 21 16:56:33 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:33 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b76cda9c-4527-4ea4-a256-58819dc83afb_v48u3_z7" returned: 0 in 0.358s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b76cda9c-4527-4ea4-a256-58819dc83afb_v48u3_z7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:33 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aaf9b686-69e0-497d-87d3-72172d33f217" returned: 0 in 0.452s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aaf9b686-69e0-497d-87d3-72172d33f217 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:33 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3 1073741824" returned: 0 in 0.536s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:33 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aaf9b686-69e0-497d-87d3-72172d33f217 Sep 21 16:56:33 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:33 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3 Sep 21 16:56:33 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:33 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b76cda9c-4527-4ea4-a256-58819dc83afb_v48u3_z7 Sep 21 16:56:33 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:33 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-aaf9b686-69e0-497d-87d3-72172d33f217" returned: 0 in 0.277s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-quobyte-aaf9b686-69e0-497d-87d3-72172d33f217" released by "delete_volume" :: held 0.792s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:33 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b76cda9c-4527-4ea4-a256-58819dc83afb_v48u3_z7" returned: 1 in 0.352s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b76cda9c-4527-4ea4-a256-58819dc83afb_v48u3_z7' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:56:33 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[58034cd5-6791-4cf6-9caa-0c7e94aeda25]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3" returned: 0 in 0.310s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.384s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1606193741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8486036f-8da7-417a-9824-4f681f3dba25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='314463f54e5f4535bb95ed285ab721da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:27Z,use_quota=True,user_id='c8188241ba194838bdcb8a311305212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Creating volume 8486036f-8da7-417a-9824-4f681f3dba25 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:33 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8486036f-8da7-417a-9824-4f681f3dba25 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Created reservations ['931de9c0-9123-4ae3-9736-d451eb781a7d', '8a5ed31a-277c-424c-9a85-33c16eca52ef', 'cd00d100-57a3-49d9-adf6-72862c247ba7', '2b1f79d7-3a4c-48cc-8541-e2128c508c9c'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:33 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8486036f-8da7-417a-9824-4f681f3dba25 1073741824 Sep 21 16:56:33 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64388fff-dfe7-4a22-9487-b70fa8e53202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535134af-45aa-4550-a32b-5f92ea4dcdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:33 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3 (7c8102cb-c0c3-4623-aa58-02eb85cef4f3): created successfully Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535134af-45aa-4550-a32b-5f92ea4dcdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Flow 'volume_create_manager' (f33e02fc-dca8-47d3-b67a-1bb75903387d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:33 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD Sep 21 16:56:33 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d1b7f911-086c-4f85-87a7-13bd4fe4b869 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Created volume successfully. Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:33 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:33 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:34 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:34 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.302s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:34 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Deleted volume successfully. Sep 21 16:56:34 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD Sep 21 16:56:34 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-35c09b9e-92ab-4090-ac24-05084b4b51a2 tempest-CreateVolumesFromImageTest-52621790 None] Lock "cinder-aaf9b686-69e0-497d-87d3-72172d33f217-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:34 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8486036f-8da7-417a-9824-4f681f3dba25 1073741824" returned: 0 in 0.583s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8486036f-8da7-417a-9824-4f681f3dba25 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:34 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8486036f-8da7-417a-9824-4f681f3dba25 Sep 21 16:56:34 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:34 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] b76cda9c-4527-4ea4-a256-58819dc83afb was raw, converting to qcow2 {{(pid=86030) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:34 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 Sep 21 16:56:34 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:34 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8486036f-8da7-417a-9824-4f681f3dba25" returned: 0 in 0.258s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.885s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Acquiring lock "cinder-quobyte-f22bb3b4-635c-417c-b61e-10900ea88105-799a1808-e59c-4d2c-b6a8-ff1e234f67e9" by "_create_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Lock "cinder-quobyte-f22bb3b4-635c-417c-b61e-10900ea88105-799a1808-e59c-4d2c-b6a8-ff1e234f67e9" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Creating volume 799a1808-e59c-4d2c-b6a8-ff1e234f67e9 from snapshot f22bb3b4-635c-417c-b61e-10900ea88105 {{(pid=86030) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Acquiring lock "cinder-quobyte-799a1808-e59c-4d2c-b6a8-ff1e234f67e9" by "_copy_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (930c5fb8-4ead-403e-aed2-17b77b6f96a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8486036f-8da7-417a-9824-4f681f3dba25', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d34f99-af8c-42b3-a660-f2d8e96b0352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Lock "cinder-quobyte-799a1808-e59c-4d2c-b6a8-ff1e234f67e9" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] snapshot: f22bb3b4-635c-417c-b61e-10900ea88105, volume: 799a1808-e59c-4d2c-b6a8-ff1e234f67e9, {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 16:56:34 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Volume volume-8486036f-8da7-417a-9824-4f681f3dba25 (8486036f-8da7-417a-9824-4f681f3dba25): created successfully Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d34f99-af8c-42b3-a660-f2d8e96b0352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Flow 'volume_create_manager' (df419687-daca-4be5-810e-0ec820fe870a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:34 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e280847e-6464-40bd-9933-f4e554ad1906 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Created volume successfully. Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[e978584d-6ef1-4a42-b2c1-398e50067b3e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:34 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 Sep 21 16:56:34 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:35 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6" returned: 0 in 0.533s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b76cda9c-4527-4ea4-a256-58819dc83afb__24srz3sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:56:35 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Converted 0.00 MB image at 0.00 MB/s Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:35 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 1G Sep 21 16:56:35 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "cinder-8486036f-8da7-417a-9824-4f681f3dba25-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:35 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105" returned: 0 in 0.494s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4333767e-8954-46ec-bf68-cc3a4b25eb85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-8486036f-8da7-417a-9824-4f681f3dba25-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[449c2168-d72f-4d7f-af12-68df070b9f37]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "cinder-quobyte-8486036f-8da7-417a-9824-4f681f3dba25" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-quobyte-8486036f-8da7-417a-9824-4f681f3dba25" acquired by "delete_volume" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[534dd87a-9a41-48a6-b0ca-522428592c93]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8486036f-8da7-417a-9824-4f681f3dba25 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:35 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 1G" returned: 0 in 0.413s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Downloaded image b76cda9c-4527-4ea4-a256-58819dc83afb ((None, [{'url': 'file:///opt/stack/data/glance/images/b76cda9c-4527-4ea4-a256-58819dc83afb', 'metadata': {}}])) to volume a810fd20-8953-4033-8d07-bfdf7f65d7a6 successfully. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Temporary image b76cda9c-4527-4ea4-a256-58819dc83afb for user 5c944daf15b84c31810b243f191a74f9 is deleted. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Marking volume a810fd20-8953-4033-8d07-bfdf7f65d7a6 as bootable. {{(pid=86030) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 21 16:56:35 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 Sep 21 16:56:35 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Copying metadata from image b76cda9c-4527-4ea4-a256-58819dc83afb to a810fd20-8953-4033-8d07-bfdf7f65d7a6. {{(pid=86030) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Creating volume glance metadata for volume a810fd20-8953-4033-8d07-bfdf7f65d7a6 backed by image b76cda9c-4527-4ea4-a256-58819dc83afb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b76cda9c-4527-4ea4-a256-58819dc83afb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ddc6d24aee8a8a9edb508956a380425b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86030) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 16:56:35 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8486036f-8da7-417a-9824-4f681f3dba25 Sep 21 16:56:35 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443dda45-f931-4005-a234-4b6411a5cf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6', 'volume_size': 1, 'image_id': 'b76cda9c-4527-4ea4-a256-58819dc83afb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b76cda9c-4527-4ea4-a256-58819dc83afb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ddc6d24aee8a8a9edb508956a380425b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a110acfc6df64605b3d3cfb54f23972e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b2f13e58d41b5317ad94da503ab0eb0424cfa63d27e9a8e44035e3da5d69a287584861b9781413b04e5dfbdaf754d86914ab76c8107f003166fd824838ba08e', 'id': 'b76cda9c-4527-4ea4-a256-58819dc83afb', 'created_at': datetime.datetime(2026, 9, 21, 14, 56, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 56, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b76cda9c-4527-4ea4-a256-58819dc83afb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662cfbef-cbe7-417a-b2a1-a7f09cbe5f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:35 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Volume volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 (a810fd20-8953-4033-8d07-bfdf7f65d7a6): created successfully Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (662cfbef-cbe7-417a-b2a1-a7f09cbe5f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Flow 'volume_create_manager' (78fd2483-a601-45f6-b25e-26ed477f13a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:35 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8fa3b646-2112-4877-8e69-0dccf3edb66d tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Created volume successfully. Sep 21 16:56:35 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85" returned: 0 in 0.561s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Creating direct copy from snapshot {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG cinder.utils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Path /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9 not found in is_blk_device check {{(pid=86030) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:35 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8486036f-8da7-417a-9824-4f681f3dba25" returned: 0 in 0.468s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8486036f-8da7-417a-9824-4f681f3dba25 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:35 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9 Sep 21 16:56:35 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:35 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8486036f-8da7-417a-9824-4f681f3dba25 Sep 21 16:56:35 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:36 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8486036f-8da7-417a-9824-4f681f3dba25" returned: 0 in 0.332s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Acquiring lock "cinder-a810fd20-8953-4033-8d07-bfdf7f65d7a6-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-quobyte-8486036f-8da7-417a-9824-4f681f3dba25" released by "delete_volume" :: held 0.869s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Lock "cinder-a810fd20-8953-4033-8d07-bfdf7f65d7a6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Acquiring lock "cinder-quobyte-a810fd20-8953-4033-8d07-bfdf7f65d7a6" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Lock "cinder-quobyte-a810fd20-8953-4033-8d07-bfdf7f65d7a6" acquired by "delete_volume" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Created reservations ['432c6422-7742-41ec-8997-78c6e7c38109', 'a62b8a6e-e298-4c77-b219-9f647f50b198', '825576ed-356e-45ab-81c6-d308f368f3db', '889709ef-a149-453c-b504-97f5769a8553'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca8433e-3f11-4a8a-b8ff-be0e8cfcedd8]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:36 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:36 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:36 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 Sep 21 16:56:36 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:37 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.516s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:37 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Deleted volume successfully. Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c71f0138-ced4-4b9b-8845-4dd69c1f226a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-8486036f-8da7-417a-9824-4f681f3dba25-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:37 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6" returned: 0 in 0.862s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:37 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6 Sep 21 16:56:37 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "cinder-7c8102cb-c0c3-4623-aa58-02eb85cef4f3-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-7c8102cb-c0c3-4623-aa58-02eb85cef4f3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:37 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "cinder-quobyte-7c8102cb-c0c3-4623-aa58-02eb85cef4f3" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a810fd20-8953-4033-8d07-bfdf7f65d7a6" returned: 0 in 0.519s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-quobyte-7c8102cb-c0c3-4623-aa58-02eb85cef4f3" acquired by "delete_volume" :: waited 0.058s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Lock "cinder-quobyte-a810fd20-8953-4033-8d07-bfdf7f65d7a6" released by "delete_volume" :: held 1.519s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[61796748-982e-4cb0-a078-554607d88c7f]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:37 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Created reservations ['0b1dab7e-5f0c-4731-b0ae-2aa5c754efb1', 'cdbc25ee-9b2a-41e8-bcb4-b61c6c98c9f2', '3bd8d5e2-70b9-4602-bc70-e5ac2d747907', 'e8f36e1b-cadb-4b8c-bd36-f700959f72e5'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:38 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3 Sep 21 16:56:38 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:38 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:38 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:38 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3" returned: 0 in 0.683s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:38 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3 Sep 21 16:56:38 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:38 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.611s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:38 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:38 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Deleted volume successfully. Sep 21 16:56:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-04d098da-c0ef-4d42-93e2-790fb68614b2 tempest-VolumeAndVolumeTypeFromImageTest-1950369423 None] Lock "cinder-a810fd20-8953-4033-8d07-bfdf7f65d7a6-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:39 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-7c8102cb-c0c3-4623-aa58-02eb85cef4f3" returned: 0 in 0.694s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-quobyte-7c8102cb-c0c3-4623-aa58-02eb85cef4f3" released by "delete_volume" :: held 1.474s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:39 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Created reservations ['bae8b0fa-4f12-4b4c-9fdd-15e615df2b67', '586777de-e767-4a90-a71e-f30565304881', '1b81277f-ba0a-4c8a-a53c-9e7f49cf7850', '2c592f2f-b0e3-4928-9be1-c5b926de3a82'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:39 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:39 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "cinder-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:40 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "cinder-quobyte-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.704s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:40 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:40 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Deleted volume successfully. Sep 21 16:56:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-quobyte-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5" acquired by "delete_volume" :: waited 0.045s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:40 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-73e28e48-f484-483b-a3d8-3550d0ed8518 tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-7c8102cb-c0c3-4623-aa58-02eb85cef4f3-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:40 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb0cd28-0f50-491b-9bca-9def94552c8f]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:40 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5 Sep 21 16:56:40 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:41 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5" returned: 0 in 0.823s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:41 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5 Sep 21 16:56:41 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:41 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5" returned: 0 in 0.535s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-quobyte-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5" released by "delete_volume" :: held 1.488s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Created reservations ['7caf49df-0ca1-407f-b065-9eacf1d55d75', '395b02ac-4659-4ead-b716-02a98d914c02', '85bf8e81-6768-4b18-bf15-5ac766fbf7c8', '312a609b-56cf-4df5-bf79-91d55c2e3dee'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:42 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:42 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Flow 'volume_create_manager' (96e22757-5f85-4a81-82c4-56c17482c90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22182f29-0bee-4501-bbf3-a724a5a92d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:42 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.408s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22182f29-0bee-4501-bbf3-a724a5a92d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345668571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32c4ea6-4948-45f7-9ba1-48bccab5e3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aa5833e7a04bd3b306742953eb1c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:42Z,use_quota=True,user_id='0e87846c74ae4c998c7b3f02bd38323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b6a7d7-7111-49e2-a744-4eb6ccfb7c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b6a7d7-7111-49e2-a744-4eb6ccfb7c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d617c531-fd8a-4632-991e-cd8507d67b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d617c531-fd8a-4632-991e-cd8507d67b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32c4ea6-4948-45f7-9ba1-48bccab5e3be', 'volume_name': 'volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe30708-dd67-421e-abc4-a671a18f88f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe30708-dd67-421e-abc4-a671a18f88f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deccbe61-7002-4090-afd2-f7a5001dc3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:42 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Volume f32c4ea6-4948-45f7-9ba1-48bccab5e3be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be', 'volume_size': 1} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:42 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Deleted volume successfully. Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "cinder-b002cec7-67ad-4cb3-9eed-9e3b3ced1237-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f70bb7c3-7f58-439d-ada6-ca657fa79d4a tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-74c70bbe-31a5-445e-b0d8-9ed21ba8c0d5-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-b002cec7-67ad-4cb3-9eed-9e3b3ced1237-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "cinder-quobyte-b002cec7-67ad-4cb3-9eed-9e3b3ced1237" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-quobyte-b002cec7-67ad-4cb3-9eed-9e3b3ced1237" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4abe38f-2a5b-48fa-bdd3-e63baa207d55]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:43 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237 Sep 21 16:56:43 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:43 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237" returned: 0 in 0.617s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:43 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237 Sep 21 16:56:43 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:44 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b002cec7-67ad-4cb3-9eed-9e3b3ced1237" returned: 0 in 0.460s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-quobyte-b002cec7-67ad-4cb3-9eed-9e3b3ced1237" released by "delete_volume" :: held 1.168s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:44 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Created reservations ['09e995e4-4e8e-446a-8dd9-84610fb37947', '6c3b5e88-33c9-44ec-a2a2-de0eb3dce1c1', '37406d4c-c9b8-464c-a2c1-81b437ba4ca8', '8d6454d1-5230-4f56-a26d-6d63d12ab91e'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:44 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:44 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:44 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.445s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:44 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:44 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Deleted volume successfully. Sep 21 16:56:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0ac2d7a3-7e97-4ffa-b8fd-c0e2f8f3c89f tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-b002cec7-67ad-4cb3-9eed-9e3b3ced1237-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "cinder-4036b611-6117-466e-9fa5-90bf94663d9e-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-4036b611-6117-466e-9fa5-90bf94663d9e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "cinder-quobyte-4036b611-6117-466e-9fa5-90bf94663d9e" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-quobyte-4036b611-6117-466e-9fa5-90bf94663d9e" acquired by "delete_volume" :: waited 0.027s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:45 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd09c17-2ca3-4dda-a7d9-53f2c794bc2a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4036b611-6117-466e-9fa5-90bf94663d9e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:45 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4036b611-6117-466e-9fa5-90bf94663d9e Sep 21 16:56:45 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:45 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9" returned: 0 in 9.887s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:45 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85, size 1024.00 MB, duration 9.89 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9 {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:56:45 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Converted 1024.00 MB image at 103.56 MB/s Sep 21 16:56:45 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9 is being set with open permissions: ugo+rw Sep 21 16:56:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:45 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9 Sep 21 16:56:45 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:45 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4036b611-6117-466e-9fa5-90bf94663d9e" returned: 0 in 0.492s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4036b611-6117-466e-9fa5-90bf94663d9e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:45 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4036b611-6117-466e-9fa5-90bf94663d9e Sep 21 16:56:45 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:46 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9" returned: 0 in 0.285s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Lock "cinder-quobyte-799a1808-e59c-4d2c-b6a8-ff1e234f67e9" released by "_copy_volume_from_snapshot" :: held 11.357s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Lock "cinder-quobyte-f22bb3b4-635c-417c-b61e-10900ea88105-799a1808-e59c-4d2c-b6a8-ff1e234f67e9" released by "_create_volume_from_snapshot" :: held 11.456s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.478s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.414s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345668571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32c4ea6-4948-45f7-9ba1-48bccab5e3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aa5833e7a04bd3b306742953eb1c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:42Z,use_quota=True,user_id='0e87846c74ae4c998c7b3f02bd38323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Creating volume f32c4ea6-4948-45f7-9ba1-48bccab5e3be {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:46 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:46 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be 1073741824 Sep 21 16:56:46 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a849817-b757-4de5-8a97-52267e99d189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9', 'volume_size': 1, 'snapshot_id': 'f22bb3b4-635c-417c-b61e-10900ea88105'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77ea677-c4ee-4f9e-9f24-fbc5245e9380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:46 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:46 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Volume volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9 (799a1808-e59c-4d2c-b6a8-ff1e234f67e9): created successfully Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77ea677-c4ee-4f9e-9f24-fbc5245e9380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Flow 'volume_create_manager' (d4dd1956-74b0-4a57-81a0-5b8d31254fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4036b611-6117-466e-9fa5-90bf94663d9e" returned: 0 in 0.331s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-quobyte-4036b611-6117-466e-9fa5-90bf94663d9e" released by "delete_volume" :: held 0.915s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8f77424e-328a-4004-8dae-17dac5640127 tempest-VolumeDependencyTests-161761153 None] Created volume successfully. Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Created reservations ['286e5576-3980-480f-929c-3abef15cc39b', '61302050-6311-45ed-8e49-a4b8208f74c5', '7dbb20ef-7dd0-49cb-bbf1-8e3ca2ceb67b', '84fec2e3-47a8-47ef-bed3-85c7a7fea666'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:46 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:46 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "cinder-9abf8415-5c1a-41c4-a460-c1ea6caa67d4-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-9abf8415-5c1a-41c4-a460-c1ea6caa67d4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "cinder-quobyte-9abf8415-5c1a-41c4-a460-c1ea6caa67d4" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-quobyte-9abf8415-5c1a-41c4-a460-c1ea6caa67d4" acquired by "delete_volume" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[10158a89-6911-4570-9dac-ad8ad0030c3c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:46 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.344s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Deleted volume successfully. Sep 21 16:56:46 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4 Sep 21 16:56:46 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:46 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be 1073741824" returned: 0 in 0.631s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ece3da3b-8bc4-44f7-a85e-3e31d9cde05e tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-4036b611-6117-466e-9fa5-90bf94663d9e-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:46 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be Sep 21 16:56:46 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:47 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4" returned: 0 in 0.452s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:47 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4 Sep 21 16:56:47 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:47 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be" returned: 0 in 0.315s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deccbe61-7002-4090-afd2-f7a5001dc3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0294aeb-aee3-4284-bfab-c5cff732db07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:47 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Volume volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be (f32c4ea6-4948-45f7-9ba1-48bccab5e3be): created successfully Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0294aeb-aee3-4284-bfab-c5cff732db07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Flow 'volume_create_manager' (96e22757-5f85-4a81-82c4-56c17482c90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Flow 'volume_create_manager' (9011d330-5854-4dba-a8f7-08405558d9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3c4808-3573-45ea-a400-4297052a6ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Acquiring lock "cinder-f22bb3b4-635c-417c-b61e-10900ea88105-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:47 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3835c270-38b3-4403-a5c5-8341b7c8a5ba tempest-ProjectReaderTests-1917368107 None] Created volume successfully. Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3c4808-3573-45ea-a400-4297052a6ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-63542384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a80cca-6801-41d6-bbe6-18a2bc7bad8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a72dc62d7048a28584330a43e46840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:47Z,use_quota=True,user_id='f10789d9fe10451fb06115b7ccba9d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90d86e9-d0ec-4de9-b0db-851070984cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90d86e9-d0ec-4de9-b0db-851070984cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743d04e0-1e91-45bb-84b2-e9edf219e790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743d04e0-1e91-45bb-84b2-e9edf219e790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a80cca-6801-41d6-bbe6-18a2bc7bad8e', 'volume_name': 'volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db1884f-c756-4f28-bcbe-6c74ab95e99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db1884f-c756-4f28-bcbe-6c74ab95e99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb00064-95a9-44e2-9c72-379874555f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:47 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume 78a80cca-6801-41d6-bbe6-18a2bc7bad8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e', 'volume_size': 1} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-63542384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a80cca-6801-41d6-bbe6-18a2bc7bad8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a72dc62d7048a28584330a43e46840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:47Z,use_quota=True,user_id='f10789d9fe10451fb06115b7ccba9d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Creating volume 78a80cca-6801-41d6-bbe6-18a2bc7bad8e {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:47 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Lock "cinder-f22bb3b4-635c-417c-b61e-10900ea88105-delete_snapshot" acquired by "delete_snapshot" :: waited 0.100s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Acquiring lock "cinder-quobyte-4333767e-8954-46ec-bf68-cc3a4b25eb85" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:47 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e 1073741824 Sep 21 16:56:47 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:47 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9abf8415-5c1a-41c4-a460-c1ea6caa67d4" returned: 0 in 0.284s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-quobyte-9abf8415-5c1a-41c4-a460-c1ea6caa67d4" released by "delete_volume" :: held 0.792s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Lock "cinder-quobyte-4333767e-8954-46ec-bf68-cc3a4b25eb85" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Acquiring lock "cinder-quobyte-f22bb3b4-635c-417c-b61e-10900ea88105" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Lock "cinder-quobyte-f22bb3b4-635c-417c-b61e-10900ea88105" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Deleting offline snapshot f22bb3b4-635c-417c-b61e-10900ea88105 of volume 4333767e-8954-46ec-bf68-cc3a4b25eb85 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] snapshot_file for this snap is: volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e75c1db-3c39-455a-b099-b76622a4fdc5]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Created reservations ['3257a4c8-7afe-4ade-adc3-f3129d8dde5b', 'eb1826b7-cf20-474a-a78e-891022199b05', '15ceb650-e363-4946-a44f-91943e8a82fa', '8a70d001-ecb2-4647-adde-16997d3abe07'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:47 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 Sep 21 16:56:47 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:47 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:47 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:47 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e 1073741824" returned: 0 in 0.551s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:47 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.342s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:47 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Deleted volume successfully. Sep 21 16:56:47 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105" returned: 0 in 0.492s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4333767e-8954-46ec-bf68-cc3a4b25eb85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c91813ae-3414-41d8-b8bd-28bfb7534dcf tempest-CreateVolumesFromSourceVolumeTest-1946241531 None] Lock "cinder-9abf8415-5c1a-41c4-a460-c1ea6caa67d4-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[210ade75-6976-470a-83a1-a565693f5340]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:47 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e Sep 21 16:56:47 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:48 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 Sep 21 16:56:48 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:48 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e" returned: 0 in 0.298s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb00064-95a9-44e2-9c72-379874555f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9289f2e8-dd4a-45ff-831a-745976a99651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:48 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e (78a80cca-6801-41d6-bbe6-18a2bc7bad8e): created successfully Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9289f2e8-dd4a-45ff-831a-745976a99651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Flow 'volume_create_manager' (9011d330-5854-4dba-a8f7-08405558d9b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b57104c3-5760-45f2-9b24-65a982fbd272 tempest-CreateVolumesFromSnapshotTest-978547277 None] Created volume successfully. Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] Creating offline snapshot fb044d2b-47de-47e2-b9ba-c91c37718fce of volume f32c4ea6-4948-45f7-9ba1-48bccab5e3be {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec3a1f5-c923-4ec6-95da-38301788f7b6]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:48 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85" returned: 0 in 0.675s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:48 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be Sep 21 16:56:48 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:48 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 Sep 21 16:56:48 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:48 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be" returned: 0 in 0.433s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:48 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce 1G Sep 21 16:56:48 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:49 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105" returned: 0 in 0.398s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:49 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105 Sep 21 16:56:49 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:49 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85.f22bb3b4-635c-417c-b61e-10900ea88105" returned: 0 in 0.352s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Lock "cinder-quobyte-f22bb3b4-635c-417c-b61e-10900ea88105" released by "_delete_snapshot" :: held 2.085s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Lock "cinder-quobyte-4333767e-8954-46ec-bf68-cc3a4b25eb85" released by "delete_snapshot" :: held 2.123s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:49 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce 1G" returned: 0 in 0.587s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:49 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce Sep 21 16:56:49 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:49 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Created reservations ['43ca4d63-d65e-4030-aadd-5ff28353fcde', '0b24b3ef-6535-41a9-8ae7-ed93a0124916', '3a3211a9-7b39-46a8-a9b4-14f81495bfa6', '44f18794-1fbc-4bad-a44e-c0453e608a21'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:49 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Delete snapshot completed successfully. Sep 21 16:56:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-44cee402-9789-40b2-9ed0-307bfdde1171 tempest-VolumeDependencyTests-161761153 None] Lock "cinder-f22bb3b4-635c-417c-b61e-10900ea88105-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:49 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce" returned: 0 in 0.345s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:49 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce is being set with open permissions: ugo+rw Sep 21 16:56:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:49 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce Sep 21 16:56:49 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:50 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce" returned: 0 in 0.256s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:50 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.info Sep 21 16:56:50 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:50 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.info" returned: 0 in 0.264s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:50 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.info is being set with open permissions: ugo+rw Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Acquiring lock "cinder-4333767e-8954-46ec-bf68-cc3a4b25eb85-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:50 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.info Sep 21 16:56:50 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Lock "cinder-4333767e-8954-46ec-bf68-cc3a4b25eb85-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Acquiring lock "cinder-quobyte-4333767e-8954-46ec-bf68-cc3a4b25eb85" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Lock "cinder-quobyte-4333767e-8954-46ec-bf68-cc3a4b25eb85" acquired by "delete_volume" :: waited 0.031s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce08563-91fe-4c93-8c78-9e0bd7892c72]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:50 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.info" returned: 0 in 0.285s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.215s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] Creating offline snapshot 0a4f32fa-6251-46f9-bbb7-caf5653ada1f of volume 78a80cca-6801-41d6-bbe6-18a2bc7bad8e {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:56:50 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 Sep 21 16:56:50 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:50 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-97d8c69a-ef19-4201-9262-c864f104813b tempest-ProjectReaderTests-1917368107 None] Create snapshot completed successfully Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6099cd9-e9b2-46da-a4bd-cfc7d50d8d4a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:50 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e Sep 21 16:56:50 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:51 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85" returned: 0 in 0.469s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:51 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85 Sep 21 16:56:51 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Flow 'volume_create_manager' (4790dfd6-f76c-434b-85a4-0eb3d3f8cb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38d4b82-8202-48c7-9614-e254a4ea7970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38d4b82-8202-48c7-9614-e254a4ea7970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c90c9a-a662-4cd4-be7b-5df3817de48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd18d06b419445e89719629b24f12c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:51Z,use_quota=True,user_id='dd32dcf34d4d4eb19afd345a8b1cea76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29746834-cd6c-4ee7-ac59-db01eaac9f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29746834-cd6c-4ee7-ac59-db01eaac9f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d32cb8-d2f8-4c19-b69c-26ea04a2ac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:51 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d32cb8-d2f8-4c19-b69c-26ea04a2ac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c90c9a-a662-4cd4-be7b-5df3817de48c', 'volume_name': 'volume-26c90c9a-a662-4cd4-be7b-5df3817de48c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26db399b-9282-42b9-b103-e9dd439775d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26db399b-9282-42b9-b103-e9dd439775d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e41eded5-0b20-4a9c-81d7-bc1717e1412e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:51 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Volume 26c90c9a-a662-4cd4-be7b-5df3817de48c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c90c9a-a662-4cd4-be7b-5df3817de48c', 'volume_size': 1} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e" returned: 0 in 0.437s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:51 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f 1G Sep 21 16:56:51 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:51 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-4333767e-8954-46ec-bf68-cc3a4b25eb85" returned: 0 in 0.261s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Lock "cinder-quobyte-4333767e-8954-46ec-bf68-cc3a4b25eb85" released by "delete_volume" :: held 0.807s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Created reservations ['dc4d2a52-fd7b-4871-bf8f-b81b740f7021', '559df306-8601-43be-ad1f-09639c72696c', '3fc729d2-35bd-4524-ae1d-61523d95934a', '9ce5abfe-93a1-4340-8fa7-48584a62cc89'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:51 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:51 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Acquiring lock "cinder-799a1808-e59c-4d2c-b6a8-ff1e234f67e9-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Lock "cinder-799a1808-e59c-4d2c-b6a8-ff1e234f67e9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:51 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f 1G" returned: 0 in 0.504s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:51 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f Sep 21 16:56:51 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Acquiring lock "cinder-quobyte-799a1808-e59c-4d2c-b6a8-ff1e234f67e9" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Lock "cinder-quobyte-799a1808-e59c-4d2c-b6a8-ff1e234f67e9" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:51 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.309s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:51 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Deleted volume successfully. Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a4c827-668d-4d89-86ec-6d75bcf1a0b3]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0592e408-b012-40eb-8c38-7638ad43c5db tempest-VolumeDependencyTests-161761153 None] Lock "cinder-4333767e-8954-46ec-bf68-cc3a4b25eb85-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-fb044d2b-47de-47e2-b9ba-c91c37718fce-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-fb044d2b-47de-47e2-b9ba-c91c37718fce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-f32c4ea6-4948-45f7-9ba1-48bccab5e3be" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-f32c4ea6-4948-45f7-9ba1-48bccab5e3be" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-fb044d2b-47de-47e2-b9ba-c91c37718fce" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:52 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9 Sep 21 16:56:52 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-fb044d2b-47de-47e2-b9ba-c91c37718fce" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Deleting offline snapshot fb044d2b-47de-47e2-b9ba-c91c37718fce of volume f32c4ea6-4948-45f7-9ba1-48bccab5e3be {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] snapshot_file for this snap is: volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2392925-da9e-43ea-b12e-fb00d1004161]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:52 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f" returned: 0 in 0.381s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:52 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f is being set with open permissions: ugo+rw Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:52 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f Sep 21 16:56:52 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:52 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce Sep 21 16:56:52 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:52 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9" returned: 0 in 0.430s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:52 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9 Sep 21 16:56:52 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:52 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f" returned: 0 in 0.263s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:52 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.info Sep 21 16:56:52 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:52 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce" returned: 0 in 0.403s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[880754bf-8d74-4ea5-abc5-4176b41d19fd]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:52 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-799a1808-e59c-4d2c-b6a8-ff1e234f67e9" returned: 0 in 0.279s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Lock "cinder-quobyte-799a1808-e59c-4d2c-b6a8-ff1e234f67e9" released by "delete_volume" :: held 0.770s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:52 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be Sep 21 16:56:52 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Created reservations ['ff650010-61ee-46e4-9769-969950586735', 'a07552fc-cbc2-4505-b7a7-f0dc2804ee98', '289ed78f-3509-4e4e-bc37-6c466901370a', '7441f125-2e98-42cc-8862-ce97f24572a3'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:52 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.info" returned: 0 in 0.311s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:52 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.info is being set with open permissions: ugo+rw Sep 21 16:56:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:52 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:52 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:52 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.info Sep 21 16:56:52 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be" returned: 0 in 0.520s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:53 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:53 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.353s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:53 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce Sep 21 16:56:53 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:53 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Deleted volume successfully. Sep 21 16:56:53 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.info" returned: 0 in 0.374s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.406s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.916s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c90c9a-a662-4cd4-be7b-5df3817de48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd18d06b419445e89719629b24f12c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:51Z,use_quota=True,user_id='dd32dcf34d4d4eb19afd345a8b1cea76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Creating volume 26c90c9a-a662-4cd4-be7b-5df3817de48c {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:53 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26c90c9a-a662-4cd4-be7b-5df3817de48c 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:53 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26c90c9a-a662-4cd4-be7b-5df3817de48c 1073741824 Sep 21 16:56:53 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-09fb14f4-2869-4982-acb4-67952a70ddfb tempest-VolumeDependencyTests-161761153 None] Lock "cinder-799a1808-e59c-4d2c-b6a8-ff1e234f67e9-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:53 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-9da4fccd-8f58-4752-888f-7bbaaa59f200 tempest-CreateVolumesFromSnapshotTest-978547277 None] Create snapshot completed successfully Sep 21 16:56:53 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce" returned: 0 in 0.435s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:53 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce Sep 21 16:56:53 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:53 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26c90c9a-a662-4cd4-be7b-5df3817de48c 1073741824" returned: 0 in 0.603s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:53 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be.fb044d2b-47de-47e2-b9ba-c91c37718fce" returned: 0 in 0.343s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-fb044d2b-47de-47e2-b9ba-c91c37718fce" released by "_delete_snapshot" :: held 1.830s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-f32c4ea6-4948-45f7-9ba1-48bccab5e3be" released by "delete_snapshot" :: held 1.857s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26c90c9a-a662-4cd4-be7b-5df3817de48c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:53 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26c90c9a-a662-4cd4-be7b-5df3817de48c Sep 21 16:56:53 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:53 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Created reservations ['79b313fb-e49f-4341-8d05-521d5e69cc7c', 'de3151be-9957-4771-8ec9-64cf93d5ccec', '5ee61c1e-079a-4559-916c-dc901986aa8d', '96cc9e91-509f-4e8b-b6dc-eaae5b5a7507'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:54 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Delete snapshot completed successfully. Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8a6a7f88-5047-4c61-9f01-140630fcb869 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-fb044d2b-47de-47e2-b9ba-c91c37718fce-delete_snapshot" released by "delete_snapshot" :: held 2.067s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-f32c4ea6-4948-45f7-9ba1-48bccab5e3be-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Lock "cinder-f32c4ea6-4948-45f7-9ba1-48bccab5e3be-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-f32c4ea6-4948-45f7-9ba1-48bccab5e3be" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:56:54 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26c90c9a-a662-4cd4-be7b-5df3817de48c" returned: 0 in 0.442s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-f32c4ea6-4948-45f7-9ba1-48bccab5e3be" acquired by "delete_volume" :: waited 0.040s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e41eded5-0b20-4a9c-81d7-bc1717e1412e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c90c9a-a662-4cd4-be7b-5df3817de48c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8990fca0-0c95-43cd-be1c-46e5fdafed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82be0d6-c595-49a9-8af8-802bf4d8d540]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:54 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Volume volume-26c90c9a-a662-4cd4-be7b-5df3817de48c (26c90c9a-a662-4cd4-be7b-5df3817de48c): created successfully Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8990fca0-0c95-43cd-be1c-46e5fdafed21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Flow 'volume_create_manager' (4790dfd6-f76c-434b-85a4-0eb3d3f8cb6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:54 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-68d32efd-ed2d-4dea-97da-9aa534199582 tempest-CinderUnicodeTest-1609477618 None] Created volume successfully. Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Flow 'volume_create_manager' (bc7476a3-113e-44b4-9d02-afc194607ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3314b8bc-9754-4c44-9c76-941a2914b370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:54 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be Sep 21 16:56:54 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3314b8bc-9754-4c44-9c76-941a2914b370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1592142661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26538474-30fc-49e6-a90a-e4f5eefd99a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a72dc62d7048a28584330a43e46840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:54Z,use_quota=True,user_id='f10789d9fe10451fb06115b7ccba9d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a0b7de-60a3-492c-9f18-c14b15f2c3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a0b7de-60a3-492c-9f18-c14b15f2c3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48047bdc-75bf-46dd-a3c7-f3c54edcd49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48047bdc-75bf-46dd-a3c7-f3c54edcd49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26538474-30fc-49e6-a90a-e4f5eefd99a7', 'volume_name': 'volume-26538474-30fc-49e6-a90a-e4f5eefd99a7', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f2faaf-e66e-44ad-9924-9f82e8d98c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f2faaf-e66e-44ad-9924-9f82e8d98c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45baed2-19b5-4a9f-ba33-f266ad55194b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:54 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume 26538474-30fc-49e6-a90a-e4f5eefd99a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26538474-30fc-49e6-a90a-e4f5eefd99a7', 'volume_size': 1} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1592142661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26538474-30fc-49e6-a90a-e4f5eefd99a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a72dc62d7048a28584330a43e46840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:54Z,use_quota=True,user_id='f10789d9fe10451fb06115b7ccba9d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Creating volume 26538474-30fc-49e6-a90a-e4f5eefd99a7 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:54 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26538474-30fc-49e6-a90a-e4f5eefd99a7 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:54 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26538474-30fc-49e6-a90a-e4f5eefd99a7 1073741824 Sep 21 16:56:54 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Flow 'volume_create_manager' (b1a198f6-99fd-4a88-9ba5-26357a66c25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e8065d-674f-4768-beef-33941f34ca9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e8065d-674f-4768-beef-33941f34ca9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-741508955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15324f97-0f9f-45c7-bfc9-d1f5652f1c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a72dc62d7048a28584330a43e46840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:55Z,use_quota=True,user_id='f10789d9fe10451fb06115b7ccba9d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca52bfd6-ca54-43b9-8bf6-8bf8b8e6a167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca52bfd6-ca54-43b9-8bf6-8bf8b8e6a167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f1e0a57-1c6a-42ca-a396-45523b493016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f1e0a57-1c6a-42ca-a396-45523b493016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15324f97-0f9f-45c7-bfc9-d1f5652f1c2e', 'volume_name': 'volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c948f2-2075-4b11-ac57-ce4f00561fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c948f2-2075-4b11-ac57-ce4f00561fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160c2d1b-7783-4f52-ae2e-33aeedf89d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:55 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume 15324f97-0f9f-45c7-bfc9-d1f5652f1c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e', 'volume_size': 1} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:55 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be" returned: 0 in 0.656s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:55 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be Sep 21 16:56:55 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:55 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26538474-30fc-49e6-a90a-e4f5eefd99a7 1073741824" returned: 0 in 0.694s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:55 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f32c4ea6-4948-45f7-9ba1-48bccab5e3be" returned: 0 in 0.348s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-f32c4ea6-4948-45f7-9ba1-48bccab5e3be" released by "delete_volume" :: held 1.111s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26538474-30fc-49e6-a90a-e4f5eefd99a7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:55 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26538474-30fc-49e6-a90a-e4f5eefd99a7 Sep 21 16:56:55 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Flow 'volume_create_manager' (6b80e91a-d851-4c32-88af-ec495df6b644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c8a3ed-c230-478e-8dac-ef29e651e266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c8a3ed-c230-478e-8dac-ef29e651e266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650807078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb62e80-654f-4497-8c83-a4b0ea335c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a72dc62d7048a28584330a43e46840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:55Z,use_quota=True,user_id='f10789d9fe10451fb06115b7ccba9d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee4169e-ea61-4fd9-8262-2e2ae8b82d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee4169e-ea61-4fd9-8262-2e2ae8b82d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f8a012-06f8-40ba-a40b-f2e08bbbc2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f8a012-06f8-40ba-a40b-f2e08bbbc2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb62e80-654f-4497-8c83-a4b0ea335c26', 'volume_name': 'volume-9eb62e80-654f-4497-8c83-a4b0ea335c26', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea9ec18-6d23-4867-bbc6-a11bbf2ec1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea9ec18-6d23-4867-bbc6-a11bbf2ec1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5940535f-af84-432d-a494-b97cf5213079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:55 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume 9eb62e80-654f-4497-8c83-a4b0ea335c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb62e80-654f-4497-8c83-a4b0ea335c26', 'volume_size': 1} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Created reservations ['8a44942e-8259-4c88-bc6e-8bba315f893d', 'b0948037-4ee2-43ab-bc5e-2338d4b2df05', '4d5a17f1-1153-474e-8a26-e27043888099', 'ca3502d5-a5ce-4687-827a-c2f6dff16fdc'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:56:55 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26538474-30fc-49e6-a90a-e4f5eefd99a7" returned: 0 in 0.375s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-741508955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15324f97-0f9f-45c7-bfc9-d1f5652f1c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a72dc62d7048a28584330a43e46840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:55Z,use_quota=True,user_id='f10789d9fe10451fb06115b7ccba9d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Creating volume 15324f97-0f9f-45c7-bfc9-d1f5652f1c2e {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:55 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45baed2-19b5-4a9f-ba33-f266ad55194b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26538474-30fc-49e6-a90a-e4f5eefd99a7', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa5c70f-2c65-4f47-bc3a-fa6d4234342e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:55 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e 1073741824 Sep 21 16:56:55 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:55 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume volume-26538474-30fc-49e6-a90a-e4f5eefd99a7 (26538474-30fc-49e6-a90a-e4f5eefd99a7): created successfully Sep 21 16:56:55 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa5c70f-2c65-4f47-bc3a-fa6d4234342e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:55 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Flow 'volume_create_manager' (bc7476a3-113e-44b4-9d02-afc194607ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:56 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0cd45248-7cb2-4cad-9817-e1d9f99177f3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Created volume successfully. Sep 21 16:56:56 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Flow 'volume_create_manager' (ea4218a7-e1b6-4bd9-87a2-c59c1da4024e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954bf635-6edc-4f71-b85e-26e644374342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.369s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:56:56 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Deleted volume successfully. Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954bf635-6edc-4f71-b85e-26e644374342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1366332807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a569dd-c52b-4c61-8ace-29663633c9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a72dc62d7048a28584330a43e46840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:56Z,use_quota=True,user_id='f10789d9fe10451fb06115b7ccba9d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315aa60c-5082-4618-9f22-898e14ae66c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315aa60c-5082-4618-9f22-898e14ae66c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d459bd4-8b17-455b-bf51-8e8a838fdaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d459bd4-8b17-455b-bf51-8e8a838fdaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a569dd-c52b-4c61-8ace-29663633c9bf', 'volume_name': 'volume-16a569dd-c52b-4c61-8ace-29663633c9bf', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53291f2a-666c-4665-91d3-d817e46bd59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53291f2a-666c-4665-91d3-d817e46bd59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fae4db6-7911-43fa-b182-0aaf90801e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:56 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume 16a569dd-c52b-4c61-8ace-29663633c9bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a569dd-c52b-4c61-8ace-29663633c9bf', 'volume_size': 1} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5fe81edf-3f71-4f6e-a894-875e731438ea tempest-ProjectReaderTests-1917368107 None] Lock "cinder-f32c4ea6-4948-45f7-9ba1-48bccab5e3be-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:56:56 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e 1073741824" returned: 0 in 0.775s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:56 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e Sep 21 16:56:56 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Flow 'volume_create_manager' (bce16392-74cc-40ac-a353-7458dc06867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fb6c6b-cec9-457e-b264-8ebde69207e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fb6c6b-cec9-457e-b264-8ebde69207e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-257263021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16278ce1-03f8-4140-9ce6-f10d85731215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd18d06b419445e89719629b24f12c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:57Z,use_quota=True,user_id='dd32dcf34d4d4eb19afd345a8b1cea76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b876bbcb-fd02-4860-94a9-6aad65aa539b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b876bbcb-fd02-4860-94a9-6aad65aa539b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80229eb-7a60-45b8-aa44-50c73d43161b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80229eb-7a60-45b8-aa44-50c73d43161b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16278ce1-03f8-4140-9ce6-f10d85731215', 'volume_name': 'volume-16278ce1-03f8-4140-9ce6-f10d85731215', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef1f9ef-a50e-4ec9-9666-54e18a8b6d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef1f9ef-a50e-4ec9-9666-54e18a8b6d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39727a0-8d8f-466a-8fa7-e54e3b33fb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:56 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Volume 16278ce1-03f8-4140-9ce6-f10d85731215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16278ce1-03f8-4140-9ce6-f10d85731215', 'volume_size': 1} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:56 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Flow 'volume_create_manager' (f48bdfce-ade7-4429-97c5-db917f0ecae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6011fa-9bca-4cde-9f5d-9f20ce808350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:57 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6011fa-9bca-4cde-9f5d-9f20ce808350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-478607686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4655d8e-ad94-4712-ade1-11d9d33a326c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a72dc62d7048a28584330a43e46840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:57Z,use_quota=True,user_id='f10789d9fe10451fb06115b7ccba9d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0c2c58-4ac4-4074-8017-a70c67acdd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0c2c58-4ac4-4074-8017-a70c67acdd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fee9d78-7fe4-406a-a42e-97ad75ff3cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fee9d78-7fe4-406a-a42e-97ad75ff3cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4655d8e-ad94-4712-ade1-11d9d33a326c', 'volume_name': 'volume-a4655d8e-ad94-4712-ade1-11d9d33a326c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c863b3-a082-4132-af62-d9157731e7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c863b3-a082-4132-af62-d9157731e7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbed9a37-0f3d-4391-a426-c33ecb8d2712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:57 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume a4655d8e-ad94-4712-ade1-11d9d33a326c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4655d8e-ad94-4712-ade1-11d9d33a326c', 'volume_size': 1} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e" returned: 0 in 0.375s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.479s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650807078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb62e80-654f-4497-8c83-a4b0ea335c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a72dc62d7048a28584330a43e46840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:55Z,use_quota=True,user_id='f10789d9fe10451fb06115b7ccba9d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Creating volume 9eb62e80-654f-4497-8c83-a4b0ea335c26 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:57 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9eb62e80-654f-4497-8c83-a4b0ea335c26 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160c2d1b-7783-4f52-ae2e-33aeedf89d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed1dd6f-ad57-46c4-8284-8251fb88550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:57 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e (15324f97-0f9f-45c7-bfc9-d1f5652f1c2e): created successfully Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed1dd6f-ad57-46c4-8284-8251fb88550b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:57 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9eb62e80-654f-4497-8c83-a4b0ea335c26 1073741824 Sep 21 16:56:57 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Flow 'volume_create_manager' (b1a198f6-99fd-4a88-9ba5-26357a66c25a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:57 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-2885385e-d587-4c18-9505-4a34060a4ee6 tempest-CreateVolumesFromSnapshotTest-978547277 None] Created volume successfully. Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Flow 'volume_create_manager' (c43aec6b-347f-4687-bf4b-e958e3c54c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a042e4-76e4-4786-8a95-24c5ac62baf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a042e4-76e4-4786-8a95-24c5ac62baf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045637139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6bb910-91ef-422b-9066-4607fd74fc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aa5833e7a04bd3b306742953eb1c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:57Z,use_quota=True,user_id='0e87846c74ae4c998c7b3f02bd38323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307052d9-be71-4122-a4d6-aedddc41edbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307052d9-be71-4122-a4d6-aedddc41edbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1e26f2-84de-4955-b8ca-ec17401d58c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1e26f2-84de-4955-b8ca-ec17401d58c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e6bb910-91ef-422b-9066-4607fd74fc5b', 'volume_name': 'volume-6e6bb910-91ef-422b-9066-4607fd74fc5b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebbfca0-81a0-44d8-84e4-f84d9ecd9fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebbfca0-81a0-44d8-84e4-f84d9ecd9fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3326b354-2dcb-47b7-b7b5-a05a22ab56ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:57 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Volume 6e6bb910-91ef-422b-9066-4607fd74fc5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e6bb910-91ef-422b-9066-4607fd74fc5b', 'volume_size': 1} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:57 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9eb62e80-654f-4497-8c83-a4b0ea335c26 1073741824" returned: 0 in 0.520s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9eb62e80-654f-4497-8c83-a4b0ea335c26 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:57 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9eb62e80-654f-4497-8c83-a4b0ea335c26 Sep 21 16:56:57 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:57 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9eb62e80-654f-4497-8c83-a4b0ea335c26" returned: 0 in 0.262s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.439s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1366332807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a569dd-c52b-4c61-8ace-29663633c9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a72dc62d7048a28584330a43e46840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:56Z,use_quota=True,user_id='f10789d9fe10451fb06115b7ccba9d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Creating volume 16a569dd-c52b-4c61-8ace-29663633c9bf {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:57 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16a569dd-c52b-4c61-8ace-29663633c9bf 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5940535f-af84-432d-a494-b97cf5213079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb62e80-654f-4497-8c83-a4b0ea335c26', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:57 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16a569dd-c52b-4c61-8ace-29663633c9bf 1073741824 Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb285aa-dcc3-45c2-9b21-8bdb525c2ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:57 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:57 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume volume-9eb62e80-654f-4497-8c83-a4b0ea335c26 (9eb62e80-654f-4497-8c83-a4b0ea335c26): created successfully Sep 21 16:56:57 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb285aa-dcc3-45c2-9b21-8bdb525c2ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Flow 'volume_create_manager' (6b80e91a-d851-4c32-88af-ec495df6b644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:58 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6ec062d9-9799-4cc6-8707-686e2ef0385a tempest-CreateVolumesFromSnapshotTest-978547277 None] Created volume successfully. Sep 21 16:56:58 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16a569dd-c52b-4c61-8ace-29663633c9bf 1073741824" returned: 0 in 0.488s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16a569dd-c52b-4c61-8ace-29663633c9bf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:58 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16a569dd-c52b-4c61-8ace-29663633c9bf Sep 21 16:56:58 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:58 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16a569dd-c52b-4c61-8ace-29663633c9bf" returned: 0 in 0.253s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.750s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-257263021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16278ce1-03f8-4140-9ce6-f10d85731215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd18d06b419445e89719629b24f12c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:57Z,use_quota=True,user_id='dd32dcf34d4d4eb19afd345a8b1cea76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Creating volume 16278ce1-03f8-4140-9ce6-f10d85731215 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:58 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:58 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215 1073741824 Sep 21 16:56:58 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fae4db6-7911-43fa-b182-0aaf90801e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a569dd-c52b-4c61-8ace-29663633c9bf', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61006ffe-09e5-4b0a-84eb-9f22dacc8959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:58 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume volume-16a569dd-c52b-4c61-8ace-29663633c9bf (16a569dd-c52b-4c61-8ace-29663633c9bf): created successfully Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61006ffe-09e5-4b0a-84eb-9f22dacc8959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:58 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Flow 'volume_create_manager' (ea4218a7-e1b6-4bd9-87a2-c59c1da4024e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:58 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-828f04fd-6a9e-4fd8-809a-06cb8eaa96a8 tempest-CreateVolumesFromSnapshotTest-978547277 None] Created volume successfully. Sep 21 16:56:59 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215 1073741824" returned: 0 in 0.460s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:59 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215 Sep 21 16:56:59 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:59 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215" returned: 0 in 0.265s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.415s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-478607686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4655d8e-ad94-4712-ade1-11d9d33a326c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a72dc62d7048a28584330a43e46840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:57Z,use_quota=True,user_id='f10789d9fe10451fb06115b7ccba9d32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Creating volume a4655d8e-ad94-4712-ade1-11d9d33a326c {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:56:59 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a4655d8e-ad94-4712-ade1-11d9d33a326c 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:56:59 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a4655d8e-ad94-4712-ade1-11d9d33a326c 1073741824 Sep 21 16:56:59 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39727a0-8d8f-466a-8fa7-e54e3b33fb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16278ce1-03f8-4140-9ce6-f10d85731215', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebccb15-ffa0-4854-9506-64af993dc0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:56:59 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Volume volume-16278ce1-03f8-4140-9ce6-f10d85731215 (16278ce1-03f8-4140-9ce6-f10d85731215): created successfully Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebccb15-ffa0-4854-9506-64af993dc0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:56:59 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Flow 'volume_create_manager' (bce16392-74cc-40ac-a353-7458dc06867d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:56:59 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-88a920e5-2d4f-4a98-83f9-46e48ec62f1a tempest-CinderUnicodeTest-1609477618 None] Created volume successfully. Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:00 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a4655d8e-ad94-4712-ade1-11d9d33a326c 1073741824" returned: 0 in 0.601s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a4655d8e-ad94-4712-ade1-11d9d33a326c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:00 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a4655d8e-ad94-4712-ade1-11d9d33a326c Sep 21 16:57:00 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:00 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a4655d8e-ad94-4712-ade1-11d9d33a326c" returned: 0 in 0.257s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045637139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6bb910-91ef-422b-9066-4607fd74fc5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aa5833e7a04bd3b306742953eb1c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:56:57Z,use_quota=True,user_id='0e87846c74ae4c998c7b3f02bd38323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Creating volume 6e6bb910-91ef-422b-9066-4607fd74fc5b {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:57:00 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:00 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b 1073741824 Sep 21 16:57:00 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbed9a37-0f3d-4391-a426-c33ecb8d2712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4655d8e-ad94-4712-ade1-11d9d33a326c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e58078-868a-4e67-8be6-15ac8b726b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:00 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Volume volume-a4655d8e-ad94-4712-ade1-11d9d33a326c (a4655d8e-ad94-4712-ade1-11d9d33a326c): created successfully Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e58078-868a-4e67-8be6-15ac8b726b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Flow 'volume_create_manager' (f48bdfce-ade7-4429-97c5-db917f0ecae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:00 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-097d1420-dc39-41f3-b777-2e0723fb4fd3 tempest-CreateVolumesFromSnapshotTest-978547277 None] Created volume successfully. Sep 21 16:57:00 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b 1073741824" returned: 0 in 0.492s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:00 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:00 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b Sep 21 16:57:00 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:01 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b" returned: 0 in 0.266s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.164s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3326b354-2dcb-47b7-b7b5-a05a22ab56ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6bb910-91ef-422b-9066-4607fd74fc5b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8bcbd6-dadc-4720-944e-84b2b552f77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-a4655d8e-ad94-4712-ade1-11d9d33a326c-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] Creating offline snapshot f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 of volume 16278ce1-03f8-4140-9ce6-f10d85731215 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-a4655d8e-ad94-4712-ade1-11d9d33a326c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:01 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Volume volume-6e6bb910-91ef-422b-9066-4607fd74fc5b (6e6bb910-91ef-422b-9066-4607fd74fc5b): created successfully Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8bcbd6-dadc-4720-944e-84b2b552f77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Flow 'volume_create_manager' (c43aec6b-347f-4687-bf4b-e958e3c54c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[26afcf73-50d2-4227-93fe-28a9e3f1e704]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:01 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-cc047007-b7d0-4e01-81cd-929091243f3a tempest-ProjectReaderTests-1917368107 None] Created volume successfully. Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-quobyte-a4655d8e-ad94-4712-ade1-11d9d33a326c" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-a4655d8e-ad94-4712-ade1-11d9d33a326c" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3e8e82-0953-4fa6-b250-411dc57f791c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a4655d8e-ad94-4712-ade1-11d9d33a326c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:01 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215 Sep 21 16:57:01 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:01 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a4655d8e-ad94-4712-ade1-11d9d33a326c Sep 21 16:57:01 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:01 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215" returned: 0 in 0.494s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:01 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 1G Sep 21 16:57:01 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:01 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a4655d8e-ad94-4712-ade1-11d9d33a326c" returned: 0 in 0.507s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:01 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a4655d8e-ad94-4712-ade1-11d9d33a326c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:01 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a4655d8e-ad94-4712-ade1-11d9d33a326c Sep 21 16:57:01 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:02 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a4655d8e-ad94-4712-ade1-11d9d33a326c" returned: 0 in 0.277s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-a4655d8e-ad94-4712-ade1-11d9d33a326c" released by "delete_volume" :: held 0.846s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Created reservations ['7adfd799-41af-453b-866d-dba9286627bc', 'cfef2cff-a3ab-4b5f-9b71-f8d679b4c74e', '5410ebad-3d77-405b-b805-237cbf6fb025', '8f56fb96-02ad-4da8-b6a2-601866024a0e'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:02 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 1G" returned: 0 in 0.507s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16278ce1-03f8-4140-9ce6-f10d85731215 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:02 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16278ce1-03f8-4140-9ce6-f10d85731215 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 Sep 21 16:57:02 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:02 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:02 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-16a569dd-c52b-4c61-8ace-29663633c9bf-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-16a569dd-c52b-4c61-8ace-29663633c9bf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-quobyte-16a569dd-c52b-4c61-8ace-29663633c9bf" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-16a569dd-c52b-4c61-8ace-29663633c9bf" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9d86b8-4d50-4e93-9dbc-1cdca5644b57]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16a569dd-c52b-4c61-8ace-29663633c9bf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:02 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16278ce1-03f8-4140-9ce6-f10d85731215 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0" returned: 0 in 0.406s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:02 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 is being set with open permissions: ugo+rw Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:02 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16a569dd-c52b-4c61-8ace-29663633c9bf Sep 21 16:57:02 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:02 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 Sep 21 16:57:02 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:02 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.386s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:02 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Deleted volume successfully. Sep 21 16:57:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-14643e29-9484-41b3-955f-f36982e7f603 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-a4655d8e-ad94-4712-ade1-11d9d33a326c-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:03 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0" returned: 0 in 0.321s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:03 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16a569dd-c52b-4c61-8ace-29663633c9bf" returned: 0 in 0.455s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16a569dd-c52b-4c61-8ace-29663633c9bf {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:03 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16a569dd-c52b-4c61-8ace-29663633c9bf Sep 21 16:57:03 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:03 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.info Sep 21 16:57:03 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Flow 'volume_create_manager' (7ef423f4-eb3d-451b-900a-765d8b265416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd86fbf6-bbd1-4064-99e1-936efdb6070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:03 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd86fbf6-bbd1-4064-99e1-936efdb6070e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2133776529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc8539b-f5cb-41fd-9510-e6513d59d7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ec2bb2b7a54790b25b80a75cc683a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:03Z,use_quota=True,user_id='6a4b251a3ee54039ae4749b64f425e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2cab75-7e3d-4529-8133-ab9e0c666fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2cab75-7e3d-4529-8133-ab9e0c666fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8181b4cf-bb81-49d4-a0e2-32c43f80a451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8181b4cf-bb81-49d4-a0e2-32c43f80a451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc8539b-f5cb-41fd-9510-e6513d59d7cb', 'volume_name': 'volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500d5182-d431-43a4-a8dd-b75d35fa3e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500d5182-d431-43a4-a8dd-b75d35fa3e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ad41f2-4791-432f-b965-db7440145466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:03 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Volume 8cc8539b-f5cb-41fd-9510-e6513d59d7cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb', 'volume_size': 1} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16a569dd-c52b-4c61-8ace-29663633c9bf" returned: 0 in 0.388s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:03 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.info" returned: 0 in 0.353s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:03 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.info is being set with open permissions: ugo+rw Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-16a569dd-c52b-4c61-8ace-29663633c9bf" released by "delete_volume" :: held 0.907s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:03 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.info Sep 21 16:57:03 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Created reservations ['06c9f252-3bc6-48a7-87cd-12d802039cbc', '6d4f5cf8-61e5-47f9-9535-b5181e03f0da', '953c1389-fd22-4878-80b6-d7534fda806a', '2348d82b-ae42-4ac9-91cd-f33e32a85cf3'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:03 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:03 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:03 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.info" returned: 0 in 0.294s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.954s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] Creating offline snapshot 43f62f3e-a0aa-4970-9532-1777b318989e of volume 6e6bb910-91ef-422b-9066-4607fd74fc5b {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:57:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3099961a-1cec-45d8-b701-b1f2e19d5d62 tempest-CinderUnicodeTest-1609477618 None] Create snapshot completed successfully Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d4b3ae-ca77-497c-8d8a-608de581c117]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:03 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.265s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Deleted volume successfully. Sep 21 16:57:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ef6d85c0-4f48-4efb-a2c1-ec2cc4928f5e tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-16a569dd-c52b-4c61-8ace-29663633c9bf-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:03 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b Sep 21 16:57:03 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:04 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b" returned: 0 in 0.392s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:04 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e 1G Sep 21 16:57:04 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "cinder-f446dfb6-f138-44f4-bc1f-d3d6d41d27f0-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-f446dfb6-f138-44f4-bc1f-d3d6d41d27f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "cinder-quobyte-16278ce1-03f8-4140-9ce6-f10d85731215" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-quobyte-16278ce1-03f8-4140-9ce6-f10d85731215" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "cinder-quobyte-f446dfb6-f138-44f4-bc1f-d3d6d41d27f0" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-quobyte-f446dfb6-f138-44f4-bc1f-d3d6d41d27f0" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Deleting offline snapshot f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 of volume 16278ce1-03f8-4140-9ce6-f10d85731215 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] snapshot_file for this snap is: volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[597a94d9-eddf-4523-8fbc-5c2422b813c1]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:04 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 Sep 21 16:57:04 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:04 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e 1G" returned: 0 in 0.492s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6bb910-91ef-422b-9066-4607fd74fc5b -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-9eb62e80-654f-4497-8c83-a4b0ea335c26-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:04 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6bb910-91ef-422b-9066-4607fd74fc5b -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e Sep 21 16:57:04 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-9eb62e80-654f-4497-8c83-a4b0ea335c26-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-quobyte-9eb62e80-654f-4497-8c83-a4b0ea335c26" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-9eb62e80-654f-4497-8c83-a4b0ea335c26" acquired by "delete_volume" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c904218-a2c6-4a8a-92d8-dcf895e0cd80]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9eb62e80-654f-4497-8c83-a4b0ea335c26 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:04 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0" returned: 0 in 0.465s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16278ce1-03f8-4140-9ce6-f10d85731215(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b41c3e-cbca-4ceb-a8b6-b020b61a04ff]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:04 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9eb62e80-654f-4497-8c83-a4b0ea335c26 Sep 21 16:57:04 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:05 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e6bb910-91ef-422b-9066-4607fd74fc5b -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e" returned: 0 in 0.360s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:05 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e is being set with open permissions: ugo+rw Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:05 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215 Sep 21 16:57:05 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:05 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e Sep 21 16:57:05 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:05 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9eb62e80-654f-4497-8c83-a4b0ea335c26" returned: 0 in 0.399s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9eb62e80-654f-4497-8c83-a4b0ea335c26 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:05 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9eb62e80-654f-4497-8c83-a4b0ea335c26 Sep 21 16:57:05 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:05 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:05 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e" returned: 0 in 0.288s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215" returned: 0 in 0.403s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:05 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 Sep 21 16:57:05 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:05 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.info Sep 21 16:57:05 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:05 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-9eb62e80-654f-4497-8c83-a4b0ea335c26" returned: 0 in 0.272s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-9eb62e80-654f-4497-8c83-a4b0ea335c26" released by "delete_volume" :: held 0.720s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Created reservations ['a60fae57-e21b-41c0-9dff-07b1f18b49b9', '21060538-85da-4395-b60d-86b548989c30', '6d853ed6-1bb0-4890-925c-a6b657a9133a', 'd1be2855-7f9f-45d5-8368-f01cd6cb4ba3'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:05 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.info" returned: 0 in 0.308s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:05 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.info is being set with open permissions: ugo+rw Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:05 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:05 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:05 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.info Sep 21 16:57:05 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:05 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0" returned: 0 in 0.398s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:05 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0 Sep 21 16:57:05 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:05 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:06 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.317s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Deleted volume successfully. Sep 21 16:57:06 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.info" returned: 0 in 0.332s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.653s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2133776529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc8539b-f5cb-41fd-9510-e6513d59d7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ec2bb2b7a54790b25b80a75cc683a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:03Z,use_quota=True,user_id='6a4b251a3ee54039ae4749b64f425e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Creating volume 8cc8539b-f5cb-41fd-9510-e6513d59d7cb {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:06 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:57:06 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:06 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb 1073741824 Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215.f446dfb6-f138-44f4-bc1f-d3d6d41d27f0" returned: 0 in 0.362s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:06 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-quobyte-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-1c941ec6-f952-466f-9edf-ae495d45a2e9 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-9eb62e80-654f-4497-8c83-a4b0ea335c26-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e" acquired by "delete_volume" :: waited 0.051s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-93c58141-0977-44f0-8a3c-c4f5e2a40003 tempest-ProjectReaderTests-1917368107 None] Create snapshot completed successfully Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-quobyte-f446dfb6-f138-44f4-bc1f-d3d6d41d27f0" released by "_delete_snapshot" :: held 1.793s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac00ef7-3a22-4064-800e-dbaaafdb6777]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-quobyte-16278ce1-03f8-4140-9ce6-f10d85731215" released by "delete_snapshot" :: held 1.888s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Created reservations ['004c6530-bf1e-490e-903e-818c5d2790b6', '1c4828e0-0370-4541-9865-1e9860d96a0f', 'a7a85986-3c53-46e7-a794-d0f5763fbe48', '8179b94a-a091-4c20-ba51-f0ff34818729'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:06 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e Sep 21 16:57:06 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Delete snapshot completed successfully. Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2b77dd0c-6633-47f8-8963-14255aaa208a tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-f446dfb6-f138-44f4-bc1f-d3d6d41d27f0-delete_snapshot" released by "delete_snapshot" :: held 2.036s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "cinder-16278ce1-03f8-4140-9ce6-f10d85731215-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-16278ce1-03f8-4140-9ce6-f10d85731215-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "cinder-quobyte-16278ce1-03f8-4140-9ce6-f10d85731215" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-quobyte-16278ce1-03f8-4140-9ce6-f10d85731215" acquired by "delete_volume" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b15a9d-8f39-4391-abe3-3a754e043a13]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:06 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:06 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e" returned: 0 in 0.442s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb 1073741824" returned: 0 in 0.578s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:06 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e Sep 21 16:57:06 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:06 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb Sep 21 16:57:06 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:06 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215 Sep 21 16:57:06 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:06 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e" returned: 0 in 0.281s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e" released by "delete_volume" :: held 0.780s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:07 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb" returned: 0 in 0.285s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ad41f2-4791-432f-b965-db7440145466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f983c3bd-a4ec-41a0-ab93-38d9de8e7389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Created reservations ['04b1cce6-51c1-4bb3-85a1-f846c13bfec8', 'c215fe5a-b483-4d0b-92fb-a33ca34265d5', 'c026c265-d60a-47c4-806a-120b93674a78', '07a8053d-5293-4c14-81ef-47fd9e4c78b7'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:07 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Volume volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb (8cc8539b-f5cb-41fd-9510-e6513d59d7cb): created successfully Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f983c3bd-a4ec-41a0-ab93-38d9de8e7389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Flow 'volume_create_manager' (7ef423f4-eb3d-451b-900a-765d8b265416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:07 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-88d1c5b8-062c-46ee-a775-752876220890 tempest-ProjectReaderTests-1031819727 None] Created volume successfully. Sep 21 16:57:07 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215" returned: 0 in 0.486s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-43f62f3e-a0aa-4970-9532-1777b318989e-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:07 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215 Sep 21 16:57:07 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Lock "cinder-43f62f3e-a0aa-4970-9532-1777b318989e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-6e6bb910-91ef-422b-9066-4607fd74fc5b" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-6e6bb910-91ef-422b-9066-4607fd74fc5b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-43f62f3e-a0aa-4970-9532-1777b318989e" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:07 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:07 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-43f62f3e-a0aa-4970-9532-1777b318989e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Deleting offline snapshot 43f62f3e-a0aa-4970-9532-1777b318989e of volume 6e6bb910-91ef-422b-9066-4607fd74fc5b {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] snapshot_file for this snap is: volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[119bc2a2-7b68-4c5f-9fc7-d69cdd3973ca]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:07 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e Sep 21 16:57:07 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:07 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-16278ce1-03f8-4140-9ce6-f10d85731215" returned: 0 in 0.278s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-quobyte-16278ce1-03f8-4140-9ce6-f10d85731215" released by "delete_volume" :: held 0.852s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:07 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.285s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:07 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Deleted volume successfully. Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-06530563-4606-40a4-8d19-00eb3b0b0524 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-15324f97-0f9f-45c7-bfc9-d1f5652f1c2e-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Created reservations ['691c9441-26ad-4431-824b-ff597f6151bf', '4ec7305b-3972-425a-8e1d-82ecbab6f462', '8ef52a2c-d4dd-48a3-b3a0-15a03447dff9', '1fdc972c-cee7-41d6-998c-c9c4066f4cff'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:07 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:07 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "cinder-26c90c9a-a662-4cd4-be7b-5df3817de48c-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-26c90c9a-a662-4cd4-be7b-5df3817de48c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:07 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e" returned: 0 in 0.466s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e6bb910-91ef-422b-9066-4607fd74fc5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Acquiring lock "cinder-8cc8539b-f5cb-41fd-9510-e6513d59d7cb-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0a1551-dab3-48d3-bac4-0abdc3b97cb9]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Lock "cinder-8cc8539b-f5cb-41fd-9510-e6513d59d7cb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:07 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:07 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "cinder-quobyte-26c90c9a-a662-4cd4-be7b-5df3817de48c" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-quobyte-26c90c9a-a662-4cd4-be7b-5df3817de48c" acquired by "delete_volume" :: waited 0.043s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:07 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b Sep 21 16:57:07 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Acquiring lock "cinder-quobyte-8cc8539b-f5cb-41fd-9510-e6513d59d7cb" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:08 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b6a855-acb9-4fdf-9f47-fb2aa394c989]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26c90c9a-a662-4cd4-be7b-5df3817de48c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Lock "cinder-quobyte-8cc8539b-f5cb-41fd-9510-e6513d59d7cb" acquired by "delete_volume" :: waited 0.031s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.403s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:08 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Deleted volume successfully. Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[676afe1f-5633-421c-bd1b-afe203f39d91]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9d1b8dc3-ea3d-4664-974a-f7418f1b2676 tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-16278ce1-03f8-4140-9ce6-f10d85731215-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:08 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26c90c9a-a662-4cd4-be7b-5df3817de48c Sep 21 16:57:08 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:08 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.311s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 29 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:57:08 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb Sep 21 16:57:08 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-26538474-30fc-49e6-a90a-e4f5eefd99a7-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:08 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b" returned: 0 in 0.472s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-26538474-30fc-49e6-a90a-e4f5eefd99a7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:08 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e Sep 21 16:57:08 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-quobyte-26538474-30fc-49e6-a90a-e4f5eefd99a7" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-26538474-30fc-49e6-a90a-e4f5eefd99a7" acquired by "delete_volume" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[f133c122-d220-47f3-81dc-5ad85e4260c0]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26538474-30fc-49e6-a90a-e4f5eefd99a7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:08 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26c90c9a-a662-4cd4-be7b-5df3817de48c" returned: 0 in 0.509s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26c90c9a-a662-4cd4-be7b-5df3817de48c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:08 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26c90c9a-a662-4cd4-be7b-5df3817de48c Sep 21 16:57:08 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:08 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26538474-30fc-49e6-a90a-e4f5eefd99a7 Sep 21 16:57:08 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:08 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb" returned: 0 in 0.560s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:08 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb Sep 21 16:57:08 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:08 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e" returned: 0 in 0.436s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:08 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e Sep 21 16:57:08 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:08 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26c90c9a-a662-4cd4-be7b-5df3817de48c" returned: 0 in 0.325s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-quobyte-26c90c9a-a662-4cd4-be7b-5df3817de48c" released by "delete_volume" :: held 0.901s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:08 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26538474-30fc-49e6-a90a-e4f5eefd99a7" returned: 0 in 0.459s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26538474-30fc-49e6-a90a-e4f5eefd99a7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:08 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26538474-30fc-49e6-a90a-e4f5eefd99a7 Sep 21 16:57:08 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Created reservations ['cbecfd16-747c-46b6-b517-8301bd37ea10', '1a9d37e3-eae2-4f37-90a7-895063ddbb95', 'e08c2841-a10f-435f-89e9-d7d0e4bfe0a7', 'f779f90c-e637-465f-94cf-2a5bd12aea98'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:08 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8cc8539b-f5cb-41fd-9510-e6513d59d7cb" returned: 0 in 0.349s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Lock "cinder-quobyte-8cc8539b-f5cb-41fd-9510-e6513d59d7cb" released by "delete_volume" :: held 0.973s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:09 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b.43f62f3e-a0aa-4970-9532-1777b318989e" returned: 0 in 0.332s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:09 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:09 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-43f62f3e-a0aa-4970-9532-1777b318989e" released by "_delete_snapshot" :: held 1.871s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Created reservations ['d4e67d25-9692-440b-9ab9-3d386ae67998', 'bc0aceb5-7c5c-4785-863f-8aab6c154221', '569897c5-4f87-47b4-9f03-802c1f39ab5b', 'dacc420c-02a4-4c7a-b10b-f8c3f8fe27c7'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-6e6bb910-91ef-422b-9066-4607fd74fc5b" released by "delete_snapshot" :: held 1.902s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:09 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-26538474-30fc-49e6-a90a-e4f5eefd99a7" returned: 0 in 0.329s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-26538474-30fc-49e6-a90a-e4f5eefd99a7" released by "delete_volume" :: held 0.873s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:09 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:09 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Created reservations ['3a24f458-fafc-4c6a-ab06-cc7ab28d1aff', '9ad7d40a-3823-45f1-a476-07ad9714e646', '2c29415c-a9f7-4897-bab2-f6cd3fe420c7', '58d768d4-408b-4e1d-b548-5d0173678471'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Created reservations ['daa99461-c955-44f6-8f5a-8afb74ad5199', '9c450f28-5fb3-47fa-9221-291671e42bc6', '63ed2224-0b0b-4274-9b44-2d78de79e10a', 'a0338561-bb12-410a-bc92-2ccc98d673f7'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:09 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.306s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:09 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Delete snapshot completed successfully. Sep 21 16:57:09 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Deleted volume successfully. Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-6ba8dd60-9c8c-454f-94dd-8c5c026c06eb tempest-ProjectReaderTests-1917368107 None] Lock "cinder-43f62f3e-a0aa-4970-9532-1777b318989e-delete_snapshot" released by "delete_snapshot" :: held 2.193s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-ea8e4da2-cca1-4526-ab80-d98445ba1e78 tempest-CinderUnicodeTest-1609477618 None] Lock "cinder-26c90c9a-a662-4cd4-be7b-5df3817de48c-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:09 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:09 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-0a4f32fa-6251-46f9-bbb7-caf5653ada1f-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-0a4f32fa-6251-46f9-bbb7-caf5653ada1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-quobyte-78a80cca-6801-41d6-bbe6-18a2bc7bad8e" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:09 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-78a80cca-6801-41d6-bbe6-18a2bc7bad8e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-quobyte-0a4f32fa-6251-46f9-bbb7-caf5653ada1f" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.301s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:09 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Deleted volume successfully. Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-0a4f32fa-6251-46f9-bbb7-caf5653ada1f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Deleting offline snapshot 0a4f32fa-6251-46f9-bbb7-caf5653ada1f of volume 78a80cca-6801-41d6-bbe6-18a2bc7bad8e {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] snapshot_file for this snap is: volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b7926fb0-277e-424a-a1c1-d27e8ac6608d tempest-ProjectReaderTests-1031819727 None] Lock "cinder-8cc8539b-f5cb-41fd-9510-e6513d59d7cb-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[802b3dbb-1347-478e-96c4-a72717645d61]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:09 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f Sep 21 16:57:09 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:09 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.298s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:09 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Deleted volume successfully. Sep 21 16:57:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5f31f0fa-f71e-45a8-bd4d-91be85c8a19b tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-26538474-30fc-49e6-a90a-e4f5eefd99a7-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:10 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f" returned: 0 in 0.421s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[febd850a-afcf-45ee-b5e5-5faf85253eb7]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:10 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e Sep 21 16:57:10 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-6e6bb910-91ef-422b-9066-4607fd74fc5b-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Lock "cinder-6e6bb910-91ef-422b-9066-4607fd74fc5b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-6e6bb910-91ef-422b-9066-4607fd74fc5b" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-6e6bb910-91ef-422b-9066-4607fd74fc5b" acquired by "delete_volume" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:10 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e" returned: 0 in 0.527s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e21d656-2214-44e4-b105-129af5817f21]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:10 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f Sep 21 16:57:10 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Flow 'volume_create_manager' (d0b87161-de17-4907-af20-f44ec02a1377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb2374c-b2da-43a1-894b-d548faae5a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb2374c-b2da-43a1-894b-d548faae5a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804035665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe22cd32-80aa-4456-be4b-efd291a0712a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ec2bb2b7a54790b25b80a75cc683a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:11Z,use_quota=True,user_id='6a4b251a3ee54039ae4749b64f425e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db50636a-5bb2-45f8-953c-739244416bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db50636a-5bb2-45f8-953c-739244416bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2437bd2a-d803-44a8-bc87-88d105932680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2437bd2a-d803-44a8-bc87-88d105932680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe22cd32-80aa-4456-be4b-efd291a0712a', 'volume_name': 'volume-fe22cd32-80aa-4456-be4b-efd291a0712a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9e9474-ff44-4959-a9b2-bb88ac8a9c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9e9474-ff44-4959-a9b2-bb88ac8a9c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23188d76-05ef-4515-a1b5-94c7f32962d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:10 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Volume fe22cd32-80aa-4456-be4b-efd291a0712a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe22cd32-80aa-4456-be4b-efd291a0712a', 'volume_size': 1} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804035665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe22cd32-80aa-4456-be4b-efd291a0712a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ec2bb2b7a54790b25b80a75cc683a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:11Z,use_quota=True,user_id='6a4b251a3ee54039ae4749b64f425e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Creating volume fe22cd32-80aa-4456-be4b-efd291a0712a {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:57:10 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:10 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:57:10 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:57:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe22cd32-80aa-4456-be4b-efd291a0712a 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:10 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe22cd32-80aa-4456-be4b-efd291a0712a 1073741824 Sep 21 16:57:10 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:11 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f" returned: 0 in 0.453s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:11 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b" returned: 0 in 0.457s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:11 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f Sep 21 16:57:11 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:11 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b Sep 21 16:57:11 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:11 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe22cd32-80aa-4456-be4b-efd291a0712a 1073741824" returned: 0 in 0.545s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe22cd32-80aa-4456-be4b-efd291a0712a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:11 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe22cd32-80aa-4456-be4b-efd291a0712a Sep 21 16:57:11 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:11 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-6e6bb910-91ef-422b-9066-4607fd74fc5b" returned: 0 in 0.313s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:11 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e.0a4f32fa-6251-46f9-bbb7-caf5653ada1f" returned: 0 in 0.358s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-6e6bb910-91ef-422b-9066-4607fd74fc5b" released by "delete_volume" :: held 0.887s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-0a4f32fa-6251-46f9-bbb7-caf5653ada1f" released by "_delete_snapshot" :: held 1.919s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-78a80cca-6801-41d6-bbe6-18a2bc7bad8e" released by "delete_snapshot" :: held 1.955s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Created reservations ['612a40bd-565e-43ad-92df-9e43631d78b5', 'e9f8afbe-f718-49ae-a571-fcc93d1f1fae', 'fe874c10-724e-448c-bbd8-663c9abb8349', '6438525b-9db4-464f-b714-2eb517b2e003'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Created reservations ['12345751-8221-478d-a3ed-1d1cd5b6ce87', '2974e6ac-e4cf-4132-930d-3a88465339d9', '4816ee10-e892-40a0-8850-71eced0646f4', '30b9456c-24aa-4f8e-8782-fcbafb2b1ec2'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:11 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe22cd32-80aa-4456-be4b-efd291a0712a" returned: 0 in 0.363s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23188d76-05ef-4515-a1b5-94c7f32962d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe22cd32-80aa-4456-be4b-efd291a0712a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:11 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:11 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c54895f-bf53-4da1-9fd4-3a906d1474c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:11 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Volume volume-fe22cd32-80aa-4456-be4b-efd291a0712a (fe22cd32-80aa-4456-be4b-efd291a0712a): created successfully Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c54895f-bf53-4da1-9fd4-3a906d1474c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Flow 'volume_create_manager' (d0b87161-de17-4907-af20-f44ec02a1377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:11 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Delete snapshot completed successfully. Sep 21 16:57:11 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-74ec57e5-4683-450c-ae15-93b7e3dfdb9b tempest-ProjectReaderTests-1031819727 None] Created volume successfully. Sep 21 16:57:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5b7c1c23-65ee-425c-85ef-9e2c7e859419 tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-0a4f32fa-6251-46f9-bbb7-caf5653ada1f-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:12 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.280s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:12 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:12 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Deleted volume successfully. Sep 21 16:57:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b9644fb4-239d-4369-8ee9-52b9f82fe77d tempest-ProjectReaderTests-1917368107 None] Lock "cinder-6e6bb910-91ef-422b-9066-4607fd74fc5b-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-78a80cca-6801-41d6-bbe6-18a2bc7bad8e-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-78a80cca-6801-41d6-bbe6-18a2bc7bad8e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "cinder-quobyte-78a80cca-6801-41d6-bbe6-18a2bc7bad8e" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-78a80cca-6801-41d6-bbe6-18a2bc7bad8e" acquired by "delete_volume" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Acquiring lock "cinder-fe22cd32-80aa-4456-be4b-efd291a0712a-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:12 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b6112f-6850-446d-b777-4f0e7a3a89b2]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Lock "cinder-fe22cd32-80aa-4456-be4b-efd291a0712a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Acquiring lock "cinder-quobyte-fe22cd32-80aa-4456-be4b-efd291a0712a" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Lock "cinder-quobyte-fe22cd32-80aa-4456-be4b-efd291a0712a" acquired by "delete_volume" :: waited 0.031s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[835c5809-8bef-4f2e-a0af-f5c1a7a272cc]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe22cd32-80aa-4456-be4b-efd291a0712a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:13 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e Sep 21 16:57:13 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:13 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe22cd32-80aa-4456-be4b-efd291a0712a Sep 21 16:57:13 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Flow 'volume_create_manager' (e4c1861f-2db1-4663-adbf-36840d5b76bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7d360f-66ac-43f0-8b52-0562a5ef6526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7d360f-66ac-43f0-8b52-0562a5ef6526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-648298009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dbd44f-3714-43dd-a91d-b08977c3c1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aa5833e7a04bd3b306742953eb1c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:13Z,use_quota=True,user_id='0e87846c74ae4c998c7b3f02bd38323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9d8448-d7a0-4a31-8ce2-a5006ce8f6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9d8448-d7a0-4a31-8ce2-a5006ce8f6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee76b356-99c0-47b0-9778-d4f4c289a534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee76b356-99c0-47b0-9778-d4f4c289a534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0dbd44f-3714-43dd-a91d-b08977c3c1e0', 'volume_name': 'volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb94121-2ef7-4da5-aa6d-c520a8edcca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb94121-2ef7-4da5-aa6d-c520a8edcca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a898580-1123-4cf6-96cd-9090ae1e9600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:13 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Volume e0dbd44f-3714-43dd-a91d-b08977c3c1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0', 'volume_size': 1} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-648298009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dbd44f-3714-43dd-a91d-b08977c3c1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aa5833e7a04bd3b306742953eb1c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:13Z,use_quota=True,user_id='0e87846c74ae4c998c7b3f02bd38323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Creating volume e0dbd44f-3714-43dd-a91d-b08977c3c1e0 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:57:13 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:13 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 1073741824 Sep 21 16:57:13 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:13 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e" returned: 0 in 0.563s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:13 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e Sep 21 16:57:13 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:13 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe22cd32-80aa-4456-be4b-efd291a0712a" returned: 0 in 0.495s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe22cd32-80aa-4456-be4b-efd291a0712a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:13 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe22cd32-80aa-4456-be4b-efd291a0712a Sep 21 16:57:13 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:13 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-78a80cca-6801-41d6-bbe6-18a2bc7bad8e" returned: 0 in 0.453s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-quobyte-78a80cca-6801-41d6-bbe6-18a2bc7bad8e" released by "delete_volume" :: held 1.118s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-83dd933e-20c1-4d65-a88f-59191c244782 tempest-ProjectAdminTests-477128132 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6392135620117, 'free_capacity_gb': 1775.6392135620117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86030) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 21 16:57:14 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 1073741824" returned: 0 in 0.637s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Created reservations ['ae586817-5786-4fdf-8107-5bf380b95955', 'bcde961a-fd17-4b52-8b0f-aa037474e05e', 'da4f8644-d6e9-4379-8139-19fa9f190e93', '7d03ee97-33aa-49c0-ba15-c906ad23ed94'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:14 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-fe22cd32-80aa-4456-be4b-efd291a0712a" returned: 0 in 0.493s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:14 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 Sep 21 16:57:14 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Lock "cinder-quobyte-fe22cd32-80aa-4456-be4b-efd291a0712a" released by "delete_volume" :: held 1.080s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Created reservations ['b6d08c4b-8b42-4dae-b75b-37c4021f0f6d', 'c92010c5-a238-478d-9229-52bc5f39d27e', '0a41e53d-8118-4051-9533-5a7888a3be75', 'd68f6313-4157-4350-b016-cd886a370921'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:14 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:14 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:14 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:14 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:14 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0" returned: 0 in 0.400s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a898580-1123-4cf6-96cd-9090ae1e9600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1743d6e-e7d1-4c78-85a6-a1833e198f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:14 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Volume volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 (e0dbd44f-3714-43dd-a91d-b08977c3c1e0): created successfully Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1743d6e-e7d1-4c78-85a6-a1833e198f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Flow 'volume_create_manager' (e4c1861f-2db1-4663-adbf-36840d5b76bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:14 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:14 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-6cdbe5dd-43bf-4eec-9be5-3bcb6192e111 tempest-ProjectReaderTests-1917368107 None] Created volume successfully. Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.319s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:14 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Deleted volume successfully. Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-fa42f6af-ab02-4db0-8120-e110b4bffd0f tempest-CreateVolumesFromSnapshotTest-978547277 None] Lock "cinder-78a80cca-6801-41d6-bbe6-18a2bc7bad8e-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:14 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.316s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:14 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Deleted volume successfully. Sep 21 16:57:14 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d51b67c3-139e-446a-9a2e-90be9e0b800d tempest-ProjectReaderTests-1031819727 None] Lock "cinder-fe22cd32-80aa-4456-be4b-efd291a0712a-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] Creating offline snapshot a522d67f-3c63-4f6c-bb84-1befdfa856df of volume e0dbd44f-3714-43dd-a91d-b08977c3c1e0 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:57:15 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[697dbe1f-fdaa-412e-8456-892c3084d862]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:16 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 Sep 21 16:57:16 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:16 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0" returned: 0 in 0.572s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:16 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df 1G Sep 21 16:57:16 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:17 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df 1G" returned: 0 in 0.654s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:17 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df Sep 21 16:57:17 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:17 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df" returned: 0 in 0.372s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:17 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df is being set with open permissions: ugo+rw Sep 21 16:57:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:17 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df Sep 21 16:57:17 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:17 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df" returned: 0 in 0.293s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:17 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.info Sep 21 16:57:17 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:18 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.info" returned: 0 in 0.294s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:18 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.info is being set with open permissions: ugo+rw Sep 21 16:57:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:18 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.info Sep 21 16:57:18 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:18 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.info" returned: 0 in 0.287s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.621s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:18 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-1ccca44a-932f-4b55-a3b2-c77eaaaa3060 tempest-ProjectReaderTests-1917368107 None] Create snapshot completed successfully Sep 21 16:57:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-a522d67f-3c63-4f6c-bb84-1befdfa856df-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-a522d67f-3c63-4f6c-bb84-1befdfa856df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-e0dbd44f-3714-43dd-a91d-b08977c3c1e0" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-e0dbd44f-3714-43dd-a91d-b08977c3c1e0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-a522d67f-3c63-4f6c-bb84-1befdfa856df" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-a522d67f-3c63-4f6c-bb84-1befdfa856df" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Deleting offline snapshot a522d67f-3c63-4f6c-bb84-1befdfa856df of volume e0dbd44f-3714-43dd-a91d-b08977c3c1e0 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] snapshot_file for this snap is: volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeab87c0-abcf-4c4c-b273-3d9cb02bc921]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:19 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df Sep 21 16:57:19 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:19 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df" returned: 0 in 0.455s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c52d0fe-f885-435c-b24f-89bd36da4148]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:19 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 Sep 21 16:57:19 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=330,cinder:SELECT=225,cinder:INSERT=90,cinder:DELETE=32 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=247,cinder:UPDATE=326,cinder:INSERT=77,cinder:DELETE=27 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (a119d453-96d0-4b81-b927-57514cc77646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524c17c7-f801-478d-8eff-f8c3781a22bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524c17c7-f801-478d-8eff-f8c3781a22bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1361848598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ca7878-97ee-4679-995f-d85d5f0a36be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:20Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676e8958-161e-4d04-b7ff-a9a4b78111f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676e8958-161e-4d04-b7ff-a9a4b78111f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c41803-02a8-4321-ad5c-a99a57098f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c41803-02a8-4321-ad5c-a99a57098f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33ca7878-97ee-4679-995f-d85d5f0a36be', 'volume_name': 'volume-33ca7878-97ee-4679-995f-d85d5f0a36be', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24da030f-7351-41cb-be45-e8233883e5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24da030f-7351-41cb-be45-e8233883e5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725c5d34-5fc7-4bcc-9a82-d1b0cb1b5d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:19 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Volume 33ca7878-97ee-4679-995f-d85d5f0a36be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33ca7878-97ee-4679-995f-d85d5f0a36be', 'volume_size': 1} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1361848598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ca7878-97ee-4679-995f-d85d5f0a36be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:20Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Creating volume 33ca7878-97ee-4679-995f-d85d5f0a36be {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:57:19 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:57:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:20 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be 1073741824 Sep 21 16:57:20 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:20 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0" returned: 0 in 0.478s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:20 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df Sep 21 16:57:20 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:20 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df" returned: 0 in 0.418s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:20 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be 1073741824" returned: 0 in 0.555s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:20 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df Sep 21 16:57:20 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:20 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be Sep 21 16:57:20 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:20 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0.a522d67f-3c63-4f6c-bb84-1befdfa856df" returned: 0 in 0.424s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-a522d67f-3c63-4f6c-bb84-1befdfa856df" released by "_delete_snapshot" :: held 1.958s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-e0dbd44f-3714-43dd-a91d-b08977c3c1e0" released by "delete_snapshot" :: held 1.989s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:21 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be" returned: 0 in 0.479s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:21 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:57:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725c5d34-5fc7-4bcc-9a82-d1b0cb1b5d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ca7878-97ee-4679-995f-d85d5f0a36be', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d5be0a-e05a-46e2-a915-4e41e5a6f7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:21 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Created reservations ['d0aa1e53-7be2-43d5-8466-09ecade6de8c', '041b2823-eba9-412c-8229-50392ed51a01', '3172e545-3471-4d1e-8a36-b703ce62653d', '7f50d5b9-98c2-4fd7-a6db-396900973773'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:21 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Volume volume-33ca7878-97ee-4679-995f-d85d5f0a36be (33ca7878-97ee-4679-995f-d85d5f0a36be): created successfully Sep 21 16:57:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d5be0a-e05a-46e2-a915-4e41e5a6f7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:21 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (a119d453-96d0-4b81-b927-57514cc77646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:21 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-692ac391-b3d8-480d-af52-66775046f21d tempest-ProjectMemberTests-1629542409 None] Created volume successfully. Sep 21 16:57:21 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Delete snapshot completed successfully. Sep 21 16:57:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-caa8fd3f-9f5c-4d1e-a711-3d29c57d6ac5 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-a522d67f-3c63-4f6c-bb84-1befdfa856df-delete_snapshot" released by "delete_snapshot" :: held 2.213s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-e0dbd44f-3714-43dd-a91d-b08977c3c1e0-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] Creating offline snapshot 6c8027c8-ae9b-4651-bae1-c4405ae38f25 of volume 33ca7878-97ee-4679-995f-d85d5f0a36be {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Lock "cinder-e0dbd44f-3714-43dd-a91d-b08977c3c1e0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[598d8df1-8b7f-4ffb-80d9-3306092656b1]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-e0dbd44f-3714-43dd-a91d-b08977c3c1e0" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-e0dbd44f-3714-43dd-a91d-b08977c3c1e0" acquired by "delete_volume" :: waited 0.027s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:22 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be Sep 21 16:57:22 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b17970-cef7-4d0c-a106-aa5d20c20dd7]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Flow 'volume_create_manager' (89277a30-cfee-473b-817d-5c4b148fca3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69048902-5d03-4e2a-b030-eaab1e574f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69048902-5d03-4e2a-b030-eaab1e574f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8454a705-5bcb-476e-bd7d-07cce9b26e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1845a252771749f991ce1f0e6d6b477b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:23Z,use_quota=True,user_id='f5b23f4d6d8c4dc3a9cce17fc3e56f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:22 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 Sep 21 16:57:22 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19b143b-710b-4b3d-9428-15f73a6d02da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19b143b-710b-4b3d-9428-15f73a6d02da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93857a28-68ba-4e43-948b-4e723217406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG cinder.image.glance [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Creating Keystone auth plugin from conf {{(pid=86030) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 16:57:22 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be" returned: 0 in 0.479s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:22 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 1G Sep 21 16:57:22 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93857a28-68ba-4e43-948b-4e723217406d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8454a705-5bcb-476e-bd7d-07cce9b26e2c', 'volume_name': 'volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c', 'volume_size': 1, 'image_id': '1bd3653f-291f-4b19-9a2a-c6af9fa335a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bd3653f-291f-4b19-9a2a-c6af9fa335a8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8b0716620280c7a762917fc58577987', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1845a252771749f991ce1f0e6d6b477b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9600d79d71198f0c5c26a3dd720c4fbf0f622ce33d80f7962e7179d467f765cdc7794c0230c5960e133e2ca16a72e7f3086e25fcb187f26714fcb87180c90dc4', 'id': '1bd3653f-291f-4b19-9a2a-c6af9fa335a8', 'created_at': datetime.datetime(2026, 9, 21, 14, 57, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 57, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bd3653f-291f-4b19-9a2a-c6af9fa335a8/file', 'properties': {}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:23 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486a96c4-6428-466b-8840-c280e8fe6242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (486a96c4-6428-466b-8840-c280e8fe6242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fdc7d2-3fd8-4539-86a5-02e194a9f6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:23 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Volume 8454a705-5bcb-476e-bd7d-07cce9b26e2c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c', 'volume_size': 1, 'image_id': '1bd3653f-291f-4b19-9a2a-c6af9fa335a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bd3653f-291f-4b19-9a2a-c6af9fa335a8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8b0716620280c7a762917fc58577987', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1845a252771749f991ce1f0e6d6b477b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9600d79d71198f0c5c26a3dd720c4fbf0f622ce33d80f7962e7179d467f765cdc7794c0230c5960e133e2ca16a72e7f3086e25fcb187f26714fcb87180c90dc4', 'id': '1bd3653f-291f-4b19-9a2a-c6af9fa335a8', 'created_at': datetime.datetime(2026, 9, 21, 14, 57, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 57, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bd3653f-291f-4b19-9a2a-c6af9fa335a8/file', 'properties': {}}, 'image_service': } Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Trying to clone 8454a705-5bcb-476e-bd7d-07cce9b26e2c from image 1bd3653f-291f-4b19-9a2a-c6af9fa335a8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1bd3653f-291f-4b19-9a2a-c6af9fa335a8', 'metadata': {}}]). {{(pid=86030) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0" returned: 0 in 0.542s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:23 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0 Sep 21 16:57:23 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 16:57:23 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Image download 0.00 MB at 0.00 MB/s Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[a316a6e1-8286-49c7-8354-7d8095dc0ae1]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:23 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e0dbd44f-3714-43dd-a91d-b08977c3c1e0" returned: 0 in 0.372s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:23 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD Sep 21 16:57:23 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:23 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 1G" returned: 0 in 0.660s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ca7878-97ee-4679-995f-d85d5f0a36be -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-e0dbd44f-3714-43dd-a91d-b08977c3c1e0" released by "delete_volume" :: held 1.073s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:23 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ca7878-97ee-4679-995f-d85d5f0a36be -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 Sep 21 16:57:23 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Created reservations ['e47ed7ed-81f0-4c8d-9587-edbeaae34270', '0b81a9f7-016a-4644-82e9-b85a88cc7359', '2451cf6f-791f-4da6-9092-cd5ecac92ac6', '3ff92f6f-0c00-4efb-9415-4a92b8be8e92'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:23 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:23 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:23 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:23 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD Sep 21 16:57:23 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:23 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ca7878-97ee-4679-995f-d85d5f0a36be -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25" returned: 0 in 0.406s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:23 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 is being set with open permissions: ugo+rw Sep 21 16:57:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:24 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 Sep 21 16:57:24 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:24 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.285s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:24 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Deleted volume successfully. Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-eeaafcdb-037a-4f9f-9152-ff178581e73f tempest-ProjectReaderTests-1917368107 None] Lock "cinder-e0dbd44f-3714-43dd-a91d-b08977c3c1e0-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:24 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Temporary image 1bd3653f-291f-4b19-9a2a-c6af9fa335a8 is fetched for user f5b23f4d6d8c4dc3a9cce17fc3e56f64. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 16:57:24 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25" returned: 0 in 0.291s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1402ff-d043-43e4-846c-4d94d4c43937]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:24 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.info Sep 21 16:57:24 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:24 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD Sep 21 16:57:24 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:24 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:24 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.info" returned: 0 in 0.479s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:24 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.info is being set with open permissions: ugo+rw Sep 21 16:57:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:24 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.info Sep 21 16:57:24 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:24 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD Sep 21 16:57:24 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:25 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD" returned: 1 in 0.445s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:25 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.info" returned: 0 in 0.417s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.893s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.068s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8454a705-5bcb-476e-bd7d-07cce9b26e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1845a252771749f991ce1f0e6d6b477b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:23Z,use_quota=True,user_id='f5b23f4d6d8c4dc3a9cce17fc3e56f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Creating volume 8454a705-5bcb-476e-bd7d-07cce9b26e2c {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:57:25 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:25 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c 1073741824 Sep 21 16:57:25 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:25 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d1b89506-cd48-40a3-b1f7-5b03a937f268 tempest-ProjectMemberTests-1629542409 None] Create snapshot completed successfully Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Flow 'volume_create_manager' (f7299a1e-d07b-49e1-8097-67043a056597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784debeb-7b4a-4d0e-8b36-244209bb616f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784debeb-7b4a-4d0e-8b36-244209bb616f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-112914706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62f8fbc-8191-4939-bbdf-3864a3211c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aa5833e7a04bd3b306742953eb1c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:25Z,use_quota=True,user_id='0e87846c74ae4c998c7b3f02bd38323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9086d40-c43b-458b-9d00-763a02ea1ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9086d40-c43b-458b-9d00-763a02ea1ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35768e01-f588-415e-9796-8800d74e376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35768e01-f588-415e-9796-8800d74e376a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b62f8fbc-8191-4939-bbdf-3864a3211c33', 'volume_name': 'volume-b62f8fbc-8191-4939-bbdf-3864a3211c33', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84029146-bb3d-4732-911d-45f0319089a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84029146-bb3d-4732-911d-45f0319089a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee77846d-d39c-400a-a337-5375fa85e0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:25 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Volume b62f8fbc-8191-4939-bbdf-3864a3211c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b62f8fbc-8191-4939-bbdf-3864a3211c33', 'volume_size': 1} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-6c8027c8-ae9b-4651-bae1-c4405ae38f25-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-6c8027c8-ae9b-4651-bae1-c4405ae38f25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-33ca7878-97ee-4679-995f-d85d5f0a36be" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-33ca7878-97ee-4679-995f-d85d5f0a36be" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-6c8027c8-ae9b-4651-bae1-c4405ae38f25" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-6c8027c8-ae9b-4651-bae1-c4405ae38f25" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Deleting offline snapshot 6c8027c8-ae9b-4651-bae1-c4405ae38f25 of volume 33ca7878-97ee-4679-995f-d85d5f0a36be {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] snapshot_file for this snap is: volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf9862e-ac72-4508-af03-cddccbb4efd8]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:25 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 Sep 21 16:57:25 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:25 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c 1073741824" returned: 0 in 0.578s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:25 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c Sep 21 16:57:25 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:26 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25" returned: 0 in 0.420s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ca7878-97ee-4679-995f-d85d5f0a36be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e25d949-cfb2-4744-9d21-580080b16818]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:26 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c" returned: 0 in 0.294s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.702s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-112914706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62f8fbc-8191-4939-bbdf-3864a3211c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aa5833e7a04bd3b306742953eb1c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:25Z,use_quota=True,user_id='0e87846c74ae4c998c7b3f02bd38323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Creating volume b62f8fbc-8191-4939-bbdf-3864a3211c33 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:57:26 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:26 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be Sep 21 16:57:26 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:26 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 1073741824 Sep 21 16:57:26 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Attempting download of 1bd3653f-291f-4b19-9a2a-c6af9fa335a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/1bd3653f-291f-4b19-9a2a-c6af9fa335a8', 'metadata': {}}])) to volume 8454a705-5bcb-476e-bd7d-07cce9b26e2c. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e90bd48-41d7-46e9-af41-5dba257d75d0]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_3tz8u370 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:26 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_3tz8u370 Sep 21 16:57:26 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:26 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be" returned: 0 in 0.466s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:26 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 Sep 21 16:57:26 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:26 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:26 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 1073741824" returned: 0 in 0.631s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_3tz8u370" returned: 0 in 0.483s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_3tz8u370 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:26 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 Sep 21 16:57:26 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:27 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_3tz8u370 Sep 21 16:57:27 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:27 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25" returned: 0 in 0.477s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:27 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25 Sep 21 16:57:27 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:27 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33" returned: 0 in 0.292s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee77846d-d39c-400a-a337-5375fa85e0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b62f8fbc-8191-4939-bbdf-3864a3211c33', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a75b58c-6030-488d-bd79-9f2bcdc00d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:27 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Volume volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 (b62f8fbc-8191-4939-bbdf-3864a3211c33): created successfully Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a75b58c-6030-488d-bd79-9f2bcdc00d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Flow 'volume_create_manager' (f7299a1e-d07b-49e1-8097-67043a056597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:27 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3e77cc4b-865d-4b46-926c-dd395fc0ae2b tempest-ProjectReaderTests-1917368107 None] Created volume successfully. Sep 21 16:57:27 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_3tz8u370" returned: 1 in 0.472s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_3tz8u370' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a19335-eab8-462c-9f2e-db150509dd4b]: (4, 'raw') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:27 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be.6c8027c8-ae9b-4651-bae1-c4405ae38f25" returned: 0 in 0.378s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-6c8027c8-ae9b-4651-bae1-c4405ae38f25" released by "_delete_snapshot" :: held 1.908s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-33ca7878-97ee-4679-995f-d85d5f0a36be" released by "delete_snapshot" :: held 1.946s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:27 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD Sep 21 16:57:27 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Created reservations ['52e4fcc7-f740-4bbc-9bac-3d39d5e88f6c', '65e9342a-9cb5-4a72-bf49-52c6d328d777', 'ac2115b4-5ee5-4ec7-9774-3e749a1c6a16', '1a0998a6-a50e-415f-b56f-772352f2d495'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:27 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Delete snapshot completed successfully. Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-678d708f-3d10-4426-b135-18efb7f90141 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-6c8027c8-ae9b-4651-bae1-c4405ae38f25-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] Creating offline snapshot c24fdded-4976-4dca-add4-ddb526fd2e58 of volume b62f8fbc-8191-4939-bbdf-3864a3211c33 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8bfdb3-f0ec-4ce9-9bc2-06550ba0a2e5]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:27 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD" returned: 0 in 0.526s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:27 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 Sep 21 16:57:27 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:28 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD Sep 21 16:57:28 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:28 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] 1bd3653f-291f-4b19-9a2a-c6af9fa335a8 was raw, converting to qcow2 {{(pid=86030) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:28 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33" returned: 0 in 0.484s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:28 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c Sep 21 16:57:28 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:28 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 1G Sep 21 16:57:28 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:28 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 1G" returned: 0 in 0.532s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-33ca7878-97ee-4679-995f-d85d5f0a36be-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:28 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-33ca7878-97ee-4679-995f-d85d5f0a36be-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:28 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:28 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c" returned: 0 in 0.652s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1bd3653f-291f-4b19-9a2a-c6af9fa335a8_9z6oovcpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:57:28 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Converted 0.00 MB image at 0.00 MB/s Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:28 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c 1G Sep 21 16:57:28 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-33ca7878-97ee-4679-995f-d85d5f0a36be" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-33ca7878-97ee-4679-995f-d85d5f0a36be" acquired by "delete_volume" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[e074569e-aadc-459d-995d-2ed756af056e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:29 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be Sep 21 16:57:29 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:29 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58" returned: 0 in 0.422s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:29 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 is being set with open permissions: ugo+rw Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:29 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 Sep 21 16:57:29 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:29 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c 1G" returned: 0 in 0.451s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Downloaded image 1bd3653f-291f-4b19-9a2a-c6af9fa335a8 ((None, [{'url': 'file:///opt/stack/data/glance/images/1bd3653f-291f-4b19-9a2a-c6af9fa335a8', 'metadata': {}}])) to volume 8454a705-5bcb-476e-bd7d-07cce9b26e2c successfully. {{(pid=86030) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Temporary image 1bd3653f-291f-4b19-9a2a-c6af9fa335a8 for user f5b23f4d6d8c4dc3a9cce17fc3e56f64 is deleted. {{(pid=86030) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG cinder.volume.volume_utils [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Marking volume 8454a705-5bcb-476e-bd7d-07cce9b26e2c as bootable. {{(pid=86030) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Copying metadata from image 1bd3653f-291f-4b19-9a2a-c6af9fa335a8 to 8454a705-5bcb-476e-bd7d-07cce9b26e2c. {{(pid=86030) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Creating volume glance metadata for volume 8454a705-5bcb-476e-bd7d-07cce9b26e2c backed by image 1bd3653f-291f-4b19-9a2a-c6af9fa335a8 with: {'image_id': '1bd3653f-291f-4b19-9a2a-c6af9fa335a8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd8b0716620280c7a762917fc58577987', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86030) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 16:57:29 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62fdc7d2-3fd8-4539-86a5-02e194a9f6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c', 'volume_size': 1, 'image_id': '1bd3653f-291f-4b19-9a2a-c6af9fa335a8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bd3653f-291f-4b19-9a2a-c6af9fa335a8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8b0716620280c7a762917fc58577987', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1845a252771749f991ce1f0e6d6b477b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9600d79d71198f0c5c26a3dd720c4fbf0f622ce33d80f7962e7179d467f765cdc7794c0230c5960e133e2ca16a72e7f3086e25fcb187f26714fcb87180c90dc4', 'id': '1bd3653f-291f-4b19-9a2a-c6af9fa335a8', 'created_at': datetime.datetime(2026, 9, 21, 14, 57, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 14, 57, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bd3653f-291f-4b19-9a2a-c6af9fa335a8/file', 'properties': {}}, 'image_service': }' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2a56db-0473-4b46-af60-b1ba44b6810d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be" returned: 0 in 0.471s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:29 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58" returned: 0 in 0.293s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:29 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Volume volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c (8454a705-5bcb-476e-bd7d-07cce9b26e2c): created successfully Sep 21 16:57:29 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2a56db-0473-4b46-af60-b1ba44b6810d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:29 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Flow 'volume_create_manager' (89277a30-cfee-473b-817d-5c4b148fca3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:29 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-1230646c-e1e6-4bf7-95eb-13df4b9eff51 tempest-VolumeImageDependencyTests-688597619 None] Created volume successfully. Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:29 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.info Sep 21 16:57:29 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:29 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-33ca7878-97ee-4679-995f-d85d5f0a36be" returned: 0 in 0.304s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-33ca7878-97ee-4679-995f-d85d5f0a36be" released by "delete_volume" :: held 0.870s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:29 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.info" returned: 0 in 0.305s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:29 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.info is being set with open permissions: ugo+rw Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:29 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.info Sep 21 16:57:29 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:29 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Created reservations ['233012c0-354d-4f6e-a7b6-a52a020db2a0', '2c55d790-318b-43ce-91c9-be4010c19c5c', '824a3183-8142-477b-b474-230445e67cf0', '86387caf-30c4-4fbf-bd57-3e27c53e653e'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:30 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:30 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:30 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.info" returned: 0 in 0.287s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:30 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-71cc45ee-79a5-4736-8ff5-d704aeead172 tempest-ProjectReaderTests-1917368107 None] Create snapshot completed successfully Sep 21 16:57:30 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.306s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:30 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Deleted volume successfully. Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f41ae519-1071-4a3d-9f0e-7287154400d2 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-33ca7878-97ee-4679-995f-d85d5f0a36be-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Acquiring lock "cinder-8454a705-5bcb-476e-bd7d-07cce9b26e2c-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Lock "cinder-8454a705-5bcb-476e-bd7d-07cce9b26e2c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Acquiring lock "cinder-quobyte-8454a705-5bcb-476e-bd7d-07cce9b26e2c" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Lock "cinder-quobyte-8454a705-5bcb-476e-bd7d-07cce9b26e2c" acquired by "delete_volume" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[273d3ed0-162c-4939-9422-4e8437a727dc]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:30 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c Sep 21 16:57:30 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:30 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c" returned: 0 in 0.412s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:30 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c Sep 21 16:57:30 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-c24fdded-4976-4dca-add4-ddb526fd2e58-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Lock "cinder-c24fdded-4976-4dca-add4-ddb526fd2e58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-b62f8fbc-8191-4939-bbdf-3864a3211c33" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-b62f8fbc-8191-4939-bbdf-3864a3211c33" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-c24fdded-4976-4dca-add4-ddb526fd2e58" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-c24fdded-4976-4dca-add4-ddb526fd2e58" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Deleting offline snapshot c24fdded-4976-4dca-add4-ddb526fd2e58 of volume b62f8fbc-8191-4939-bbdf-3864a3211c33 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] snapshot_file for this snap is: volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f46f54-6a42-498d-9aaa-eeeb09dc848b]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:31 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-8454a705-5bcb-476e-bd7d-07cce9b26e2c" returned: 0 in 0.281s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Lock "cinder-quobyte-8454a705-5bcb-476e-bd7d-07cce9b26e2c" released by "delete_volume" :: held 0.753s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:31 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 Sep 21 16:57:31 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Created reservations ['e9cab01e-5424-4c5b-ae3c-8c4cd56c388d', '6e858942-5898-4322-8996-c6e08ea4fabb', '6a73fcdb-d5cf-419f-818c-039d4fef34cf', '624b1006-a629-4253-a1a9-947aca8ff114'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:31 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:31 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (650cf69e-9def-4efb-9d16-7adca2a6c66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c0d861-ef01-45c5-919f-d46444aef4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:31 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58" returned: 0 in 0.699s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b62f8fbc-8191-4939-bbdf-3864a3211c33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c0d861-ef01-45c5-919f-d46444aef4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-965541512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400a5a4d-84e1-4c66-8c06-8418644b2522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:32Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0125b5f-0469-427e-b3d4-251be0e93411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0125b5f-0469-427e-b3d4-251be0e93411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2689783f-8c8d-4949-bd63-7c6129710011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:31 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2689783f-8c8d-4949-bd63-7c6129710011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '400a5a4d-84e1-4c66-8c06-8418644b2522', 'volume_name': 'volume-400a5a4d-84e1-4c66-8c06-8418644b2522', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c179c7b-998a-4c0e-aa6f-92987b09a393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:31 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c179c7b-998a-4c0e-aa6f-92987b09a393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9db10a-d64d-4d29-a29c-6a9969023c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:32 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Volume 400a5a4d-84e1-4c66-8c06-8418644b2522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-400a5a4d-84e1-4c66-8c06-8418644b2522', 'volume_size': 1} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-965541512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400a5a4d-84e1-4c66-8c06-8418644b2522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:32Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Creating volume 400a5a4d-84e1-4c66-8c06-8418644b2522 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:57:32 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[590c08d1-808e-4f29-ab61-b0e76e38fdbc]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.592s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:32 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Deleted volume successfully. Sep 21 16:57:32 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522 1073741824 Sep 21 16:57:32 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07ca6e9c-10d2-45fc-a4bf-ceaacf3cade2 tempest-VolumeImageDependencyTests-688597619 None] Lock "cinder-8454a705-5bcb-476e-bd7d-07cce9b26e2c-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:32 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 Sep 21 16:57:32 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:32 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33" returned: 0 in 0.498s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:32 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 Sep 21 16:57:32 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:32 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522 1073741824" returned: 0 in 0.702s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:32 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522 Sep 21 16:57:32 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:33 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58" returned: 0 in 0.525s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:33 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522" returned: 0 in 0.313s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:33 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58 Sep 21 16:57:33 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9db10a-d64d-4d29-a29c-6a9969023c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-400a5a4d-84e1-4c66-8c06-8418644b2522', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500cd737-9c9a-42e6-ad79-af1628aa1f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:33 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Volume volume-400a5a4d-84e1-4c66-8c06-8418644b2522 (400a5a4d-84e1-4c66-8c06-8418644b2522): created successfully Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500cd737-9c9a-42e6-ad79-af1628aa1f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (650cf69e-9def-4efb-9d16-7adca2a6c66d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-37687fba-ff6b-4a66-a251-a850b6e7908d tempest-ProjectMemberTests-1629542409 None] Created volume successfully. Sep 21 16:57:33 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33.c24fdded-4976-4dca-add4-ddb526fd2e58" returned: 0 in 0.300s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-c24fdded-4976-4dca-add4-ddb526fd2e58" released by "_delete_snapshot" :: held 2.297s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-b62f8fbc-8191-4939-bbdf-3864a3211c33" released by "delete_snapshot" :: held 2.333s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Created reservations ['34b60347-96dc-4342-915f-d579855494a9', 'dca87161-cfb7-44ba-82a5-125b3b60c481', '4a002f32-5316-4ca6-a252-26b8a31459e1', 'f916896f-87af-4047-8d15-49a707104534'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Delete snapshot completed successfully. Sep 21 16:57:33 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-34f3edf4-18e0-4b25-8b36-1aa814fa3a9c tempest-ProjectReaderTests-1917368107 None] Lock "cinder-c24fdded-4976-4dca-add4-ddb526fd2e58-delete_snapshot" released by "delete_snapshot" :: held 2.519s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:34 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] Creating offline snapshot 1e669a48-d4b0-4ea1-a717-913a659d1a21 of volume 400a5a4d-84e1-4c66-8c06-8418644b2522 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:57:34 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e37463-bf5b-4c88-b72e-0bb5bd1f34a0]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-b62f8fbc-8191-4939-bbdf-3864a3211c33-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-b62f8fbc-8191-4939-bbdf-3864a3211c33-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:34 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522 Sep 21 16:57:34 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-b62f8fbc-8191-4939-bbdf-3864a3211c33" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:34 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-b62f8fbc-8191-4939-bbdf-3864a3211c33" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:34 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e795ab-637e-4162-9a9f-15039b3cfdd0]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:34 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 Sep 21 16:57:34 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:34 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522" returned: 0 in 0.546s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:34 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 1G Sep 21 16:57:34 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:35 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33" returned: 0 in 0.577s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:35 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33 Sep 21 16:57:35 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:35 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 1G" returned: 0 in 0.614s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400a5a4d-84e1-4c66-8c06-8418644b2522 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:35 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400a5a4d-84e1-4c66-8c06-8418644b2522 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 Sep 21 16:57:35 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:35 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b62f8fbc-8191-4939-bbdf-3864a3211c33" returned: 0 in 0.358s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-b62f8fbc-8191-4939-bbdf-3864a3211c33" released by "delete_volume" :: held 1.031s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Created reservations ['1046b8d6-19d0-4b1b-b33b-2bcf2f454db6', '12a63629-d127-4d66-8b08-3e43851fd920', 'cdc4d093-fd00-4325-aa9b-406e680c07f2', 'b6862722-e74e-48a2-b168-394aa7ac9457'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:35 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:35 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:35 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400a5a4d-84e1-4c66-8c06-8418644b2522 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21" returned: 0 in 0.471s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:35 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 is being set with open permissions: ugo+rw Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:35 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 Sep 21 16:57:35 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:35 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.283s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:35 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Deleted volume successfully. Sep 21 16:57:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-8201a3aa-1e68-4b08-bf63-18da86012434 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-b62f8fbc-8191-4939-bbdf-3864a3211c33-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:36 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21" returned: 0 in 0.329s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:36 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.info Sep 21 16:57:36 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:36 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.info" returned: 0 in 0.315s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:36 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.info is being set with open permissions: ugo+rw Sep 21 16:57:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:36 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.info Sep 21 16:57:36 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:36 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.info" returned: 0 in 0.306s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:36 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-f76eafc5-974d-4336-b00a-8460eddc2231 tempest-ProjectMemberTests-1629542409 None] Create snapshot completed successfully Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Flow 'volume_create_manager' (23c6fd37-4cc1-4d46-812a-381cc6139a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19489be2-d25d-43bf-8df4-8e0a0fc83daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19489be2-d25d-43bf-8df4-8e0a0fc83daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493260057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6e5570-0e0a-453e-b0e4-1ccc82c020aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aa5833e7a04bd3b306742953eb1c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:37Z,use_quota=True,user_id='0e87846c74ae4c998c7b3f02bd38323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa7a00e-7b35-4b67-9005-29a36b939c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa7a00e-7b35-4b67-9005-29a36b939c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816287cc-0a16-4591-92c8-fbdfa4792886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816287cc-0a16-4591-92c8-fbdfa4792886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df6e5570-0e0a-453e-b0e4-1ccc82c020aa', 'volume_name': 'volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019fb88b-6d90-49b9-94cd-73a586817a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019fb88b-6d90-49b9-94cd-73a586817a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f45624-78fd-4fab-8d88-5c430b47170e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:37 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Volume df6e5570-0e0a-453e-b0e4-1ccc82c020aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa', 'volume_size': 1} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1493260057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6e5570-0e0a-453e-b0e4-1ccc82c020aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24aa5833e7a04bd3b306742953eb1c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:37Z,use_quota=True,user_id='0e87846c74ae4c998c7b3f02bd38323c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Creating volume df6e5570-0e0a-453e-b0e4-1ccc82c020aa {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:57:37 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-1e669a48-d4b0-4ea1-a717-913a659d1a21-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-1e669a48-d4b0-4ea1-a717-913a659d1a21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-400a5a4d-84e1-4c66-8c06-8418644b2522" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:37 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa 1073741824 Sep 21 16:57:37 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-400a5a4d-84e1-4c66-8c06-8418644b2522" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-1e669a48-d4b0-4ea1-a717-913a659d1a21" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-1e669a48-d4b0-4ea1-a717-913a659d1a21" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Deleting offline snapshot 1e669a48-d4b0-4ea1-a717-913a659d1a21 of volume 400a5a4d-84e1-4c66-8c06-8418644b2522 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] snapshot_file for this snap is: volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4560b13-31f0-408e-97f8-c8e74fb22877]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:37 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 Sep 21 16:57:37 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:37 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa 1073741824" returned: 0 in 0.536s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:37 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21" returned: 0 in 0.467s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-400a5a4d-84e1-4c66-8c06-8418644b2522(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:57:37 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa Sep 21 16:57:37 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[b492ec70-4ed6-4ac7-b50e-38b341e9afac]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:38 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522 Sep 21 16:57:38 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:38 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa" returned: 0 in 0.360s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:57:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f45624-78fd-4fab-8d88-5c430b47170e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb0ea15-a2a0-40d2-98db-2e2e61e3488a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:38 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Volume volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa (df6e5570-0e0a-453e-b0e4-1ccc82c020aa): created successfully Sep 21 16:57:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb0ea15-a2a0-40d2-98db-2e2e61e3488a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:38 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Flow 'volume_create_manager' (23c6fd37-4cc1-4d46-812a-381cc6139a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:38 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-caa742b9-3556-4fce-8595-316e410daa77 tempest-ProjectReaderTests-1917368107 None] Created volume successfully. Sep 21 16:57:38 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522" returned: 0 in 0.513s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:38 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 Sep 21 16:57:38 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:38 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21" returned: 0 in 0.425s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:38 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21 Sep 21 16:57:38 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:39 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522.1e669a48-d4b0-4ea1-a717-913a659d1a21" returned: 0 in 0.293s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-1e669a48-d4b0-4ea1-a717-913a659d1a21" released by "_delete_snapshot" :: held 1.866s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-400a5a4d-84e1-4c66-8c06-8418644b2522" released by "delete_snapshot" :: held 1.900s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Created reservations ['81c4f8f6-7eac-4460-8cc1-5edf8f5c791f', '7d091188-139f-4975-8b95-d39d039c6406', '430abb10-2ac4-44bb-9aec-1534f0a3c9d6', 'c74b3452-ddac-42ca-91a4-db6ffb86c377'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:39 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Delete snapshot completed successfully. Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2d23d576-0532-4735-9fff-3321273db7d6 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-1e669a48-d4b0-4ea1-a717-913a659d1a21-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-400a5a4d-84e1-4c66-8c06-8418644b2522-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] Creating offline snapshot a9d37596-1709-4724-9386-56bb19ac03f0 of volume df6e5570-0e0a-453e-b0e4-1ccc82c020aa {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Lock "cinder-400a5a4d-84e1-4c66-8c06-8418644b2522-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[3563ab8a-facc-4732-967f-4f40b5e13170]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-400a5a4d-84e1-4c66-8c06-8418644b2522" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-400a5a4d-84e1-4c66-8c06-8418644b2522" acquired by "delete_volume" :: waited 0.042s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[90df35eb-9e89-4948-88ba-b2029af480b8]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:40 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa Sep 21 16:57:40 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:40 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522 Sep 21 16:57:40 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:40 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa" returned: 0 in 0.559s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:40 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 1G Sep 21 16:57:40 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:40 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522" returned: 0 in 0.602s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:40 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522 Sep 21 16:57:40 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:41 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 1G" returned: 0 in 0.734s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:41 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-400a5a4d-84e1-4c66-8c06-8418644b2522" returned: 0 in 0.519s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:41 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 Sep 21 16:57:41 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-400a5a4d-84e1-4c66-8c06-8418644b2522" released by "delete_volume" :: held 1.240s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Created reservations ['b57d5099-1d26-4eba-ac48-2ea2412fea4b', '6bdb6470-aa2c-41ef-89a5-a15f20015917', '760fa9a3-8af8-4df6-a5c8-ce2f5221e627', '9caaa318-af2c-4bcf-b137-38da9e14e914'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:41 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:41 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:41 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0" returned: 0 in 0.582s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:41 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 is being set with open permissions: ugo+rw Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:41 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 Sep 21 16:57:41 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:41 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.453s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:41 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Deleted volume successfully. Sep 21 16:57:41 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1c5d568-5fe0-414f-a0f7-edcb97be828d tempest-ProjectMemberTests-1629542409 None] Lock "cinder-400a5a4d-84e1-4c66-8c06-8418644b2522-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:42 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0" returned: 0 in 0.441s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:42 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.info Sep 21 16:57:42 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:42 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.info" returned: 0 in 0.405s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:42 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.info is being set with open permissions: ugo+rw Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:42 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.info Sep 21 16:57:42 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (c8069def-5a9c-4a54-b5a6-3799528b0e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb1d4ef-f22d-48f1-afc9-b427b19a5f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb1d4ef-f22d-48f1-afc9-b427b19a5f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014876619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e28e219e-588a-4b77-9319-48c808ad5218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:43Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363d96ad-1a53-46b3-81bb-ed4540864329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363d96ad-1a53-46b3-81bb-ed4540864329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3fa2c7-70c4-4237-93e3-89356400abd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3fa2c7-70c4-4237-93e3-89356400abd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e28e219e-588a-4b77-9319-48c808ad5218', 'volume_name': 'volume-e28e219e-588a-4b77-9319-48c808ad5218', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7777677-aef8-4535-a01f-c6bae4255f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7777677-aef8-4535-a01f-c6bae4255f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1aed5c-d31c-4648-baa6-d03aff687b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:42 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Volume e28e219e-588a-4b77-9319-48c808ad5218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e28e219e-588a-4b77-9319-48c808ad5218', 'volume_size': 1} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:42 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.info" returned: 0 in 0.351s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.245s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.065s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014876619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e28e219e-588a-4b77-9319-48c808ad5218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:43Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Creating volume e28e219e-588a-4b77-9319-48c808ad5218 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:57:42 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:57:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:42 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218 1073741824 Sep 21 16:57:42 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:42 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-bae30238-d018-4c7a-895e-8eecb315a422 tempest-ProjectReaderTests-1917368107 None] Create snapshot completed successfully Sep 21 16:57:43 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218 1073741824" returned: 0 in 0.500s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:43 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218 Sep 21 16:57:43 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:43 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218" returned: 0 in 0.321s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:57:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1aed5c-d31c-4648-baa6-d03aff687b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e28e219e-588a-4b77-9319-48c808ad5218', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d3e7fa-e027-4f02-9ded-474924d7e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:43 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Volume volume-e28e219e-588a-4b77-9319-48c808ad5218 (e28e219e-588a-4b77-9319-48c808ad5218): created successfully Sep 21 16:57:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d3e7fa-e027-4f02-9ded-474924d7e8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:43 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (c8069def-5a9c-4a54-b5a6-3799528b0e2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:43 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-e4cc3ca2-6417-40a3-83be-ab559f99b349 tempest-ProjectMemberTests-1629542409 None] Created volume successfully. Sep 21 16:57:43 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-a9d37596-1709-4724-9386-56bb19ac03f0-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Lock "cinder-a9d37596-1709-4724-9386-56bb19ac03f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-df6e5570-0e0a-453e-b0e4-1ccc82c020aa" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-df6e5570-0e0a-453e-b0e4-1ccc82c020aa" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-a9d37596-1709-4724-9386-56bb19ac03f0" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-a9d37596-1709-4724-9386-56bb19ac03f0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Deleting offline snapshot a9d37596-1709-4724-9386-56bb19ac03f0 of volume df6e5570-0e0a-453e-b0e4-1ccc82c020aa {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] snapshot_file for this snap is: volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[7136712d-1bbf-4d4c-95d8-c2e8eba327f4]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:44 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 Sep 21 16:57:44 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:44 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0" returned: 0 in 0.389s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda27c72-9227-4fb5-9ab8-902684e2aaf1]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:44 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa Sep 21 16:57:44 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:44 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa" returned: 0 in 0.427s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:45 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 Sep 21 16:57:45 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] Creating offline snapshot b071ef91-9e19-4c1a-86f0-3a92478f8b37 of volume e28e219e-588a-4b77-9319-48c808ad5218 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:57:45 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cbb74d-50bc-4034-8a21-28ea44178e40]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:45 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218 Sep 21 16:57:45 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:45 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0" returned: 0 in 0.633s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:45 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218" returned: 0 in 0.495s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:45 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0 Sep 21 16:57:45 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:45 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 1G Sep 21 16:57:45 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:46 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa.a9d37596-1709-4724-9386-56bb19ac03f0" returned: 0 in 0.467s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-a9d37596-1709-4724-9386-56bb19ac03f0" released by "_delete_snapshot" :: held 2.055s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-df6e5570-0e0a-453e-b0e4-1ccc82c020aa" released by "delete_snapshot" :: held 2.090s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Created reservations ['c954b604-ca8f-4158-bc4e-08bff045efd7', '8a1e04d1-bbc0-46b9-8210-979fc2d77b26', 'c3e42683-0d38-49f2-8ff7-905fdd2cd7c6', 'c85cbef6-20e2-4950-9fd3-dff023418db1'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:46 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Delete snapshot completed successfully. Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-74266280-85f7-4edd-a5bc-880c3079587a tempest-ProjectReaderTests-1917368107 None] Lock "cinder-a9d37596-1709-4724-9386-56bb19ac03f0-delete_snapshot" released by "delete_snapshot" :: held 2.362s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:46 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 1G" returned: 0 in 0.761s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e28e219e-588a-4b77-9319-48c808ad5218 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:46 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e28e219e-588a-4b77-9319-48c808ad5218 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 Sep 21 16:57:46 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:46 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e28e219e-588a-4b77-9319-48c808ad5218 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37" returned: 0 in 0.344s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:46 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 is being set with open permissions: ugo+rw Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:46 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 Sep 21 16:57:46 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Flow 'volume_create_manager' (cb7be0e2-f400-4ec4-bfdd-2834933e2a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05247218-94c5-4673-822c-d979c9301028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05247218-94c5-4673-822c-d979c9301028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-732039604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd70b6dd-911e-4b9d-97c6-71363787405c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8ee3918cd94c74a795780cac11907e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:47Z,use_quota=True,user_id='ef1e89ffe3f648119b8ef9219893f547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12480866-8b4f-4d3f-a4eb-f54166e81bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12480866-8b4f-4d3f-a4eb-f54166e81bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16c67f5-607e-4525-81be-ebcddcea65c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16c67f5-607e-4525-81be-ebcddcea65c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd70b6dd-911e-4b9d-97c6-71363787405c', 'volume_name': 'volume-bd70b6dd-911e-4b9d-97c6-71363787405c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a653ee-8d52-4e09-a0c6-ece5632f5189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a653ee-8d52-4e09-a0c6-ece5632f5189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1dc7111-0566-4e2d-90b2-1bcd36be3665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:46 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Volume bd70b6dd-911e-4b9d-97c6-71363787405c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd70b6dd-911e-4b9d-97c6-71363787405c', 'volume_size': 1} Sep 21 16:57:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:47 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37" returned: 0 in 0.260s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:47 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.info Sep 21 16:57:47 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:47 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.info" returned: 0 in 0.276s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:47 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.info is being set with open permissions: ugo+rw Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:47 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.info Sep 21 16:57:47 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-df6e5570-0e0a-453e-b0e4-1ccc82c020aa-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-df6e5570-0e0a-453e-b0e4-1ccc82c020aa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "cinder-quobyte-df6e5570-0e0a-453e-b0e4-1ccc82c020aa" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-df6e5570-0e0a-453e-b0e4-1ccc82c020aa" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bfef7c-8cb8-4336-85da-99b4e8d95c4d]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:47 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.info" returned: 0 in 0.294s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:47 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.566s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:47 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.764s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-732039604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd70b6dd-911e-4b9d-97c6-71363787405c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8ee3918cd94c74a795780cac11907e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:47Z,use_quota=True,user_id='ef1e89ffe3f648119b8ef9219893f547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Creating volume bd70b6dd-911e-4b9d-97c6-71363787405c {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:57:47 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:47 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c 1073741824 Sep 21 16:57:47 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:47 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-ee91e3b6-f0fa-4f0e-82db-1489db454465 tempest-ProjectMemberTests-1629542409 None] Create snapshot completed successfully Sep 21 16:57:47 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa" returned: 0 in 0.448s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:47 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa Sep 21 16:57:47 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:48 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c 1073741824" returned: 0 in 0.511s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:48 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c Sep 21 16:57:48 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:48 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-df6e5570-0e0a-453e-b0e4-1ccc82c020aa" returned: 0 in 0.298s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-quobyte-df6e5570-0e0a-453e-b0e4-1ccc82c020aa" released by "delete_volume" :: held 0.842s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Created reservations ['eaaf31b2-b629-4b00-9830-25b4c0ce2117', '32792237-32f4-4e05-b085-023c06d8cfea', '13334699-5f02-4873-8207-efa392b42306', 'e5046294-8819-4bbd-9030-4d3345c3c820'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-b071ef91-9e19-4c1a-86f0-3a92478f8b37-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-b071ef91-9e19-4c1a-86f0-3a92478f8b37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-e28e219e-588a-4b77-9319-48c808ad5218" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:48 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:48 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-e28e219e-588a-4b77-9319-48c808ad5218" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-b071ef91-9e19-4c1a-86f0-3a92478f8b37" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-b071ef91-9e19-4c1a-86f0-3a92478f8b37" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:48 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Deleting offline snapshot b071ef91-9e19-4c1a-86f0-3a92478f8b37 of volume e28e219e-588a-4b77-9319-48c808ad5218 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] snapshot_file for this snap is: volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c" returned: 0 in 0.386s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca59519-9891-49bf-941f-dd9ed091a255]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1dc7111-0566-4e2d-90b2-1bcd36be3665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd70b6dd-911e-4b9d-97c6-71363787405c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01259240-2e76-4185-8b45-88786259a18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:48 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Volume volume-bd70b6dd-911e-4b9d-97c6-71363787405c (bd70b6dd-911e-4b9d-97c6-71363787405c): created successfully Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01259240-2e76-4185-8b45-88786259a18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Flow 'volume_create_manager' (cb7be0e2-f400-4ec4-bfdd-2834933e2a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a4b5c17e-a814-4b3b-9726-a4a29042e211 tempest-SnapshotDependencyTests-1147019032 None] Created volume successfully. Sep 21 16:57:48 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 Sep 21 16:57:48 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:48 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.434s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:48 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Deleted volume successfully. Sep 21 16:57:48 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-5628c520-e41c-4912-b65e-8d79146dac04 tempest-ProjectReaderTests-1917368107 None] Lock "cinder-df6e5570-0e0a-453e-b0e4-1ccc82c020aa-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:49 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37" returned: 0 in 0.625s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e28e219e-588a-4b77-9319-48c808ad5218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:57:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:49 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cefbdc-97c1-436a-ad6c-8107d5dce721]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] Creating offline snapshot 42601545-ba9a-4b2c-a6a2-273bde773cb0 of volume bd70b6dd-911e-4b9d-97c6-71363787405c {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:57:49 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[5091741a-a3bb-4831-8885-f2fda994f0c5]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:49 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218 Sep 21 16:57:49 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:49 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c Sep 21 16:57:49 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:49 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218" returned: 0 in 0.485s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:49 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 Sep 21 16:57:49 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:49 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c" returned: 0 in 0.555s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:49 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 1G Sep 21 16:57:49 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:50 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37" returned: 0 in 0.446s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:50 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37 Sep 21 16:57:50 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:50 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 1G" returned: 0 in 0.599s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd70b6dd-911e-4b9d-97c6-71363787405c -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:50 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218.b071ef91-9e19-4c1a-86f0-3a92478f8b37" returned: 0 in 0.302s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:50 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd70b6dd-911e-4b9d-97c6-71363787405c -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 Sep 21 16:57:50 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-b071ef91-9e19-4c1a-86f0-3a92478f8b37" released by "_delete_snapshot" :: held 2.040s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-e28e219e-588a-4b77-9319-48c808ad5218" released by "delete_snapshot" :: held 2.073s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:50 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Created reservations ['1fd83c1a-2051-4a6f-9dfd-47f4a86f0117', '52ff86d3-6352-46e2-89a4-690ba04fea42', 'cdedfecd-9469-4648-a2d8-1fdda413309e', 'a20cf7d7-3b19-4968-a34a-209b72299863'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:50 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Delete snapshot completed successfully. Sep 21 16:57:50 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d1448598-d8d5-4d83-9295-a50a52da0844 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-b071ef91-9e19-4c1a-86f0-3a92478f8b37-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:50 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd70b6dd-911e-4b9d-97c6-71363787405c -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0" returned: 0 in 0.391s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:50 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 is being set with open permissions: ugo+rw Sep 21 16:57:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:50 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 Sep 21 16:57:50 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:51 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0" returned: 0 in 0.278s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:51 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.info Sep 21 16:57:51 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:51 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.info" returned: 0 in 0.274s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:51 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.info is being set with open permissions: ugo+rw Sep 21 16:57:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:51 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.info Sep 21 16:57:51 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-e28e219e-588a-4b77-9319-48c808ad5218-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-e28e219e-588a-4b77-9319-48c808ad5218-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:51 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.info" returned: 0 in 0.322s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.554s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-e28e219e-588a-4b77-9319-48c808ad5218" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:51 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b902340e-01ac-46dd-97c0-6825b15e3f48 tempest-SnapshotDependencyTests-1147019032 None] Create snapshot completed successfully Sep 21 16:57:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-e28e219e-588a-4b77-9319-48c808ad5218" acquired by "delete_volume" :: waited 0.037s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:51 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e5a07d-438d-437b-a05f-4e61ba47eb5b]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:52 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218 Sep 21 16:57:52 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:52 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218" returned: 0 in 0.461s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:52 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218 Sep 21 16:57:52 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:52 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-e28e219e-588a-4b77-9319-48c808ad5218" returned: 0 in 0.393s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-e28e219e-588a-4b77-9319-48c808ad5218" released by "delete_volume" :: held 0.966s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:52 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Created reservations ['a358ec02-648d-446a-bbfb-7ef6cc9eb7bb', 'e18d2b65-d085-46a4-8afd-ac27a5281f7a', '78759c8b-7e8a-4065-8fe1-caac040919a3', '295c0918-3d6e-402e-82b7-f547aed15552'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:53 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:57:53 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:57:53 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.324s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:57:53 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Deleted volume successfully. Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Flow 'volume_create_manager' (415ac3c3-263b-4c58-af77-cfdb63b0c72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc74fec-0078-493d-8a89-911fefdfa237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc74fec-0078-493d-8a89-911fefdfa237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4673b60-b8f2-413e-9dc0-7b5f9df087be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8ee3918cd94c74a795780cac11907e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=42601545-ba9a-4b2c-a6a2-273bde773cb0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:53Z,use_quota=True,user_id='ef1e89ffe3f648119b8ef9219893f547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d13d25b-1d3a-432b-aa12-b95b3496a366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d13d25b-1d3a-432b-aa12-b95b3496a366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfb2e13-7230-4d44-95b8-e08be4a296c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfb2e13-7230-4d44-95b8-e08be4a296c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b4673b60-b8f2-413e-9dc0-7b5f9df087be', 'volume_name': 'volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be', 'volume_size': 1, 'snapshot_id': '42601545-ba9a-4b2c-a6a2-273bde773cb0'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89fd103-63f0-41d3-bf9e-53d6e63cf9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89fd103-63f0-41d3-bf9e-53d6e63cf9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34dabd2-8433-4259-a50c-8956ffb9b361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:53 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Volume b4673b60-b8f2-413e-9dc0-7b5f9df087be: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be', 'volume_size': 1, 'snapshot_id': '42601545-ba9a-4b2c-a6a2-273bde773cb0'} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "cinder-quobyte-42601545-ba9a-4b2c-a6a2-273bde773cb0-b4673b60-b8f2-413e-9dc0-7b5f9df087be" by "_create_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c61f3a25-646d-4313-9936-ebb366c84802 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-e28e219e-588a-4b77-9319-48c808ad5218-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-quobyte-42601545-ba9a-4b2c-a6a2-273bde773cb0-b4673b60-b8f2-413e-9dc0-7b5f9df087be" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Creating volume b4673b60-b8f2-413e-9dc0-7b5f9df087be from snapshot 42601545-ba9a-4b2c-a6a2-273bde773cb0 {{(pid=86030) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "cinder-quobyte-b4673b60-b8f2-413e-9dc0-7b5f9df087be" by "_copy_volume_from_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-quobyte-b4673b60-b8f2-413e-9dc0-7b5f9df087be" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] snapshot: 42601545-ba9a-4b2c-a6a2-273bde773cb0, volume: b4673b60-b8f2-413e-9dc0-7b5f9df087be, {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[1089a989-1af3-4e73-baf4-c5d507a2af51]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:53 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 Sep 21 16:57:53 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:53 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0" returned: 0 in 0.410s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd70b6dd-911e-4b9d-97c6-71363787405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[dead7150-0b88-45d3-85e3-16fd896d0e8a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:57:53 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:54 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c Sep 21 16:57:54 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:54 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 21 16:57:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c" returned: 0 in 0.492s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:57:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 16:57:54 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Creating direct copy from snapshot {{(pid=86030) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 16:57:54 devstack cinder-volume[86030]: DEBUG cinder.utils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Path /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be not found in is_blk_device check {{(pid=86030) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 21 16:57:54 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:57:54 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be Sep 21 16:57:54 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:57:54 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:57:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (5112fe05-2979-4822-bbbf-8acea23e4de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:57:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec50fc1-3fcf-4356-bbc7-132762df1d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec50fc1-3fcf-4356-bbc7-132762df1d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567521380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bb4025-0906-4a6b-8943-e7b69697e10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:55Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a0669b-82ea-4897-ac27-57f58d94f81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a0669b-82ea-4897-ac27-57f58d94f81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:54 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e74574-1493-4395-aa67-125717726c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e74574-1493-4395-aa67-125717726c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32bb4025-0906-4a6b-8943-e7b69697e10a', 'volume_name': 'volume-32bb4025-0906-4a6b-8943-e7b69697e10a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38177ec-625d-4f39-a1af-0189b4640373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38177ec-625d-4f39-a1af-0189b4640373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:57:55 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b2cc93-b09d-4d31-a0c0-c3168d63cb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:57:55 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Volume 32bb4025-0906-4a6b-8943-e7b69697e10a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32bb4025-0906-4a6b-8943-e7b69697e10a', 'volume_size': 1} Sep 21 16:57:55 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:02 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be" returned: 0 in 8.068s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG cinder.image.image_utils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Image conversion details: src /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c, size 1024.00 MB, duration 8.07 sec, destination /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be {{(pid=86030) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 16:58:02 devstack cinder-volume[86030]: INFO cinder.image.image_utils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Converted 1024.00 MB image at 126.89 MB/s Sep 21 16:58:02 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be is being set with open permissions: ugo+rw Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:02 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be Sep 21 16:58:02 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:02 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be" returned: 0 in 0.276s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-quobyte-b4673b60-b8f2-413e-9dc0-7b5f9df087be" released by "_copy_volume_from_snapshot" :: held 9.352s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-quobyte-42601545-ba9a-4b2c-a6a2-273bde773cb0-b4673b60-b8f2-413e-9dc0-7b5f9df087be" released by "_create_volume_from_snapshot" :: held 9.421s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.437s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.868s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567521380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bb4025-0906-4a6b-8943-e7b69697e10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:57:55Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Creating volume 32bb4025-0906-4a6b-8943-e7b69697e10a {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:58:02 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:02 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a 1073741824 Sep 21 16:58:02 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34dabd2-8433-4259-a50c-8956ffb9b361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be', 'volume_size': 1, 'snapshot_id': '42601545-ba9a-4b2c-a6a2-273bde773cb0'}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe6e909-1f4f-4ed9-8713-9ffba77fcd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:02 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Volume volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be (b4673b60-b8f2-413e-9dc0-7b5f9df087be): created successfully Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe6e909-1f4f-4ed9-8713-9ffba77fcd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:02 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Flow 'volume_create_manager' (415ac3c3-263b-4c58-af77-cfdb63b0c72e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:02 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-a48454ae-b9a6-45b3-98ca-dd1b52442f25 tempest-SnapshotDependencyTests-1147019032 None] Created volume successfully. Sep 21 16:58:03 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a 1073741824" returned: 0 in 0.525s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:03 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a Sep 21 16:58:03 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:03 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "cinder-42601545-ba9a-4b2c-a6a2-273bde773cb0-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a" returned: 0 in 0.416s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b2cc93-b09d-4d31-a0c0-c3168d63cb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32bb4025-0906-4a6b-8943-e7b69697e10a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6246500-7372-40e1-af34-a6412fba0054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-42601545-ba9a-4b2c-a6a2-273bde773cb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "cinder-quobyte-bd70b6dd-911e-4b9d-97c6-71363787405c" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:03 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Volume volume-32bb4025-0906-4a6b-8943-e7b69697e10a (32bb4025-0906-4a6b-8943-e7b69697e10a): created successfully Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6246500-7372-40e1-af34-a6412fba0054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (5112fe05-2979-4822-bbbf-8acea23e4de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-quobyte-bd70b6dd-911e-4b9d-97c6-71363787405c" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "cinder-quobyte-42601545-ba9a-4b2c-a6a2-273bde773cb0" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:03 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-79b45c89-30ab-4762-94a9-68fc62757b39 tempest-ProjectMemberTests-1629542409 None] Created volume successfully. Sep 21 16:58:03 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-quobyte-42601545-ba9a-4b2c-a6a2-273bde773cb0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Deleting offline snapshot 42601545-ba9a-4b2c-a6a2-273bde773cb0 of volume bd70b6dd-911e-4b9d-97c6-71363787405c {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:58:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] snapshot_file for this snap is: volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:58:04 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeab76b-9562-4c63-92a9-547a36a41730]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:04 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 Sep 21 16:58:04 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:04 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0" returned: 0 in 0.413s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:04 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd70b6dd-911e-4b9d-97c6-71363787405c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:58:04 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[63258cd0-8077-4bbb-bc5e-632cffcbc2be]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:04 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:04 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c Sep 21 16:58:04 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:05 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c" returned: 0 in 0.653s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:05 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 Sep 21 16:58:05 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:05 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] Creating offline snapshot fa67527d-43f9-4d1a-9e53-a646b5e537ad of volume 32bb4025-0906-4a6b-8943-e7b69697e10a {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:58:05 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[be046bb6-981a-4ba6-bce8-56ef089a4fd6]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:05 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a Sep 21 16:58:05 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:05 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0" returned: 0 in 0.547s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:05 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0 Sep 21 16:58:05 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:05 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a" returned: 0 in 0.595s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:05 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:05 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad 1G Sep 21 16:58:05 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:06 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c.42601545-ba9a-4b2c-a6a2-273bde773cb0" returned: 0 in 0.389s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-quobyte-42601545-ba9a-4b2c-a6a2-273bde773cb0" released by "_delete_snapshot" :: held 2.139s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-quobyte-bd70b6dd-911e-4b9d-97c6-71363787405c" released by "delete_snapshot" :: held 2.174s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:06 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Created reservations ['d1b3f009-2082-4ed0-8d8d-72b6539c9b5d', 'f724e6fd-54c5-45ac-a9b8-4e531767e270', '321ff589-7018-433f-952d-6b97f5b84cc6', '02c42948-2a42-44e7-9655-f8761efcfbbe'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:06 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Delete snapshot completed successfully. Sep 21 16:58:06 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-130b449b-4b46-4cf0-a913-482334198689 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-42601545-ba9a-4b2c-a6a2-273bde773cb0-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:06 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad 1G" returned: 0 in 0.542s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32bb4025-0906-4a6b-8943-e7b69697e10a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:06 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32bb4025-0906-4a6b-8943-e7b69697e10a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad Sep 21 16:58:06 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:06 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32bb4025-0906-4a6b-8943-e7b69697e10a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad" returned: 0 in 0.312s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:06 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad is being set with open permissions: ugo+rw Sep 21 16:58:06 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:06 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad Sep 21 16:58:06 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:07 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad" returned: 0 in 0.269s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:07 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.info Sep 21 16:58:07 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "cinder-bd70b6dd-911e-4b9d-97c6-71363787405c-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-bd70b6dd-911e-4b9d-97c6-71363787405c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "cinder-quobyte-bd70b6dd-911e-4b9d-97c6-71363787405c" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-quobyte-bd70b6dd-911e-4b9d-97c6-71363787405c" acquired by "delete_volume" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ee68cb-df45-4fb8-ba61-a2ef9c75a31f]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:07 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.info" returned: 0 in 0.357s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:07 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.info is being set with open permissions: ugo+rw Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:07 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.info Sep 21 16:58:07 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:07 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c Sep 21 16:58:07 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:07 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.info" returned: 0 in 0.311s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:07 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-5c04b00b-fa2e-430f-8cf0-0295f0fef6a4 tempest-ProjectMemberTests-1629542409 None] Create snapshot completed successfully Sep 21 16:58:07 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c" returned: 0 in 0.455s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:07 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c Sep 21 16:58:07 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:07 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:07 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:58:07 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:08 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-bd70b6dd-911e-4b9d-97c6-71363787405c" returned: 0 in 0.335s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-quobyte-bd70b6dd-911e-4b9d-97c6-71363787405c" released by "delete_volume" :: held 0.893s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:08 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.334s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 29 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Created reservations ['77ebce48-4d80-442d-b821-5187153d7c94', '590fc70f-e309-4d9f-97cc-e0e8af31c3dd', 'ecffc5fd-38aa-4efc-8c74-4686d50e2284', '70c594af-3731-4cf0-9cc3-6b67621016a0'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:08 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:58:08 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "cinder-b4673b60-b8f2-413e-9dc0-7b5f9df087be-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-b4673b60-b8f2-413e-9dc0-7b5f9df087be-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "cinder-quobyte-b4673b60-b8f2-413e-9dc0-7b5f9df087be" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-quobyte-b4673b60-b8f2-413e-9dc0-7b5f9df087be" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[316c816b-f01d-4138-831c-39e61ae2d503]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-fa67527d-43f9-4d1a-9e53-a646b5e537ad-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-fa67527d-43f9-4d1a-9e53-a646b5e537ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-32bb4025-0906-4a6b-8943-e7b69697e10a" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-32bb4025-0906-4a6b-8943-e7b69697e10a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-fa67527d-43f9-4d1a-9e53-a646b5e537ad" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-fa67527d-43f9-4d1a-9e53-a646b5e537ad" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Deleting offline snapshot fa67527d-43f9-4d1a-9e53-a646b5e537ad of volume 32bb4025-0906-4a6b-8943-e7b69697e10a {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:58:08 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:08 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be Sep 21 16:58:08 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] snapshot_file for this snap is: volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.397s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:58:08 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Deleted volume successfully. Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[af240b8b-ff80-4bfa-adc8-617e901c29c8]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:08 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-07dcb062-f9b2-4fc8-abde-6cbd7c79535a tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-bd70b6dd-911e-4b9d-97c6-71363787405c-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:08 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad Sep 21 16:58:08 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:09 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be" returned: 0 in 0.479s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:09 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be Sep 21 16:58:09 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:09 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad" returned: 0 in 0.434s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32bb4025-0906-4a6b-8943-e7b69697e10a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d09b83-ce74-4d06-bd12-c8dd0c152f89]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:09 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a Sep 21 16:58:09 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:09 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-b4673b60-b8f2-413e-9dc0-7b5f9df087be" returned: 0 in 0.362s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-quobyte-b4673b60-b8f2-413e-9dc0-7b5f9df087be" released by "delete_volume" :: held 0.899s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Created reservations ['8a6866ba-3211-4eae-9008-1f6c48b826b5', 'b220aca8-217c-497e-b57e-bedf8bc46785', '3beadfeb-5c9d-4934-89d3-82e103b8b137', '9e38c046-b97f-4216-a711-75a8753011aa'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:09 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:58:09 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:09 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a" returned: 0 in 0.572s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:09 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad Sep 21 16:58:09 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:09 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.354s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:09 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:58:09 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Deleted volume successfully. Sep 21 16:58:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-4cb62107-138d-41a1-b070-4220db23e937 tempest-SnapshotDependencyTests-1147019032 None] Lock "cinder-b4673b60-b8f2-413e-9dc0-7b5f9df087be-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:10 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad" returned: 0 in 0.463s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:10 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad Sep 21 16:58:10 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:10 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:10 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a.fa67527d-43f9-4d1a-9e53-a646b5e537ad" returned: 0 in 0.281s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-fa67527d-43f9-4d1a-9e53-a646b5e537ad" released by "_delete_snapshot" :: held 1.919s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-32bb4025-0906-4a6b-8943-e7b69697e10a" released by "delete_snapshot" :: held 1.976s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:10 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Created reservations ['65455241-e6bd-4070-ac7d-af2e7258c45a', '14be46db-cf8a-4795-866c-12a9eb30ddaa', 'b6324f58-168e-4071-9ca0-7e9f3e040fbb', 'beadcb38-d75a-49f3-b991-739682e5c08a'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:10 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Delete snapshot completed successfully. Sep 21 16:58:10 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3d799be9-4dbd-4ee8-a140-6de9b5ceae84 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-fa67527d-43f9-4d1a-9e53-a646b5e537ad-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-32bb4025-0906-4a6b-8943-e7b69697e10a-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-32bb4025-0906-4a6b-8943-e7b69697e10a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:11 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-32bb4025-0906-4a6b-8943-e7b69697e10a" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-32bb4025-0906-4a6b-8943-e7b69697e10a" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:12 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbb3002-a03e-442e-adba-ee6f136aee8c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:12 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a Sep 21 16:58:12 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:12 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a" returned: 0 in 0.471s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:12 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a Sep 21 16:58:12 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:12 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:12 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-32bb4025-0906-4a6b-8943-e7b69697e10a" returned: 0 in 0.339s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:12 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-32bb4025-0906-4a6b-8943-e7b69697e10a" released by "delete_volume" :: held 0.922s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:13 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Created reservations ['bbf8e464-3a89-4670-92cb-5f1c260642f9', '6a559502-30bb-44d7-9a7b-3b2d862aa886', '60fef9a5-e944-4086-8137-c6163a087bfc', '9cec1bbf-441b-4a3f-8a56-886f104ed98f'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:13 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:13 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:58:13 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:13 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:13 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.279s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:13 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:58:13 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Deleted volume successfully. Sep 21 16:58:13 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-b13a49fd-497a-4dd5-ad7f-68d7d71ae3a9 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-32bb4025-0906-4a6b-8943-e7b69697e10a-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (65a66592-5233-4c91-a133-44e99b4c953f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0b1055-fe8d-4193-8fe3-64b2543bcbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0b1055-fe8d-4193-8fe3-64b2543bcbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1795803154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a290810f-bbb9-420e-ba21-0692ce17e0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:15Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d1096d-2ccd-4ddd-be83-9c0929830766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d1096d-2ccd-4ddd-be83-9c0929830766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11672e40-e005-4f3a-9aeb-8c9448fb94d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11672e40-e005-4f3a-9aeb-8c9448fb94d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a290810f-bbb9-420e-ba21-0692ce17e0f7', 'volume_name': 'volume-a290810f-bbb9-420e-ba21-0692ce17e0f7', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e48eb81-141c-4f97-b66a-c400bef3bc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e48eb81-141c-4f97-b66a-c400bef3bc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b52d91-6e04-473c-96a5-67ee5874a997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:14 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Volume a290810f-bbb9-420e-ba21-0692ce17e0f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a290810f-bbb9-420e-ba21-0692ce17e0f7', 'volume_size': 1} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1795803154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a290810f-bbb9-420e-ba21-0692ce17e0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:15Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Creating volume a290810f-bbb9-420e-ba21-0692ce17e0f7 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:14 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:58:15 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:15 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 1073741824 Sep 21 16:58:15 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Flow 'volume_create_manager' (a8159ffb-dd44-4542-8345-e281e1d0f1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9016bb68-3bfb-4795-a412-6982499ef5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9016bb68-3bfb-4795-a412-6982499ef5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887073262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37226c16-0a95-495f-8e65-8ab57c4c6eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8489ea44c5347259f1c55794b91ac8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:15Z,use_quota=True,user_id='312612552fe34fec878440052b6431f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e9ae9d-2174-445c-9d1a-edbe8740a3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e9ae9d-2174-445c-9d1a-edbe8740a3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0041aa1e-9373-4402-9b21-429e9a5067c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0041aa1e-9373-4402-9b21-429e9a5067c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37226c16-0a95-495f-8e65-8ab57c4c6eda', 'volume_name': 'volume-37226c16-0a95-495f-8e65-8ab57c4c6eda', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0e6227-aa37-4e6e-b186-21a9fce62407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0e6227-aa37-4e6e-b186-21a9fce62407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f06c47-88fb-474b-8e4c-400ef77cd0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:15 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Volume 37226c16-0a95-495f-8e65-8ab57c4c6eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37226c16-0a95-495f-8e65-8ab57c4c6eda', 'volume_size': 1} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:15 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 1073741824" returned: 0 in 0.481s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:15 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 Sep 21 16:58:15 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:15 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7" returned: 0 in 0.292s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.690s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887073262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37226c16-0a95-495f-8e65-8ab57c4c6eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8489ea44c5347259f1c55794b91ac8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:15Z,use_quota=True,user_id='312612552fe34fec878440052b6431f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Creating volume 37226c16-0a95-495f-8e65-8ab57c4c6eda {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:58:15 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-37226c16-0a95-495f-8e65-8ab57c4c6eda 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b52d91-6e04-473c-96a5-67ee5874a997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a290810f-bbb9-420e-ba21-0692ce17e0f7', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fcb9e2-ab6e-43e1-ae53-46b23df50cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:15 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-37226c16-0a95-495f-8e65-8ab57c4c6eda 1073741824 Sep 21 16:58:15 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:15 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Volume volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 (a290810f-bbb9-420e-ba21-0692ce17e0f7): created successfully Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fcb9e2-ab6e-43e1-ae53-46b23df50cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:15 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (65a66592-5233-4c91-a133-44e99b4c953f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:15 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b273a4be-7926-42c8-b519-5a170ed3471b tempest-ProjectMemberTests-1629542409 None] Created volume successfully. Sep 21 16:58:16 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-37226c16-0a95-495f-8e65-8ab57c4c6eda 1073741824" returned: 0 in 0.466s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-37226c16-0a95-495f-8e65-8ab57c4c6eda {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:16 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-37226c16-0a95-495f-8e65-8ab57c4c6eda Sep 21 16:58:16 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:16 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-37226c16-0a95-495f-8e65-8ab57c4c6eda" returned: 0 in 0.240s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:16 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:58:16 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f06c47-88fb-474b-8e4c-400ef77cd0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37226c16-0a95-495f-8e65-8ab57c4c6eda', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6330b9e0-b73d-4f5d-aec4-bc1e854da184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:16 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Volume volume-37226c16-0a95-495f-8e65-8ab57c4c6eda (37226c16-0a95-495f-8e65-8ab57c4c6eda): created successfully Sep 21 16:58:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6330b9e0-b73d-4f5d-aec4-bc1e854da184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:16 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Flow 'volume_create_manager' (a8159ffb-dd44-4542-8345-e281e1d0f1e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:16 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-205e93a5-fd96-4d1c-abd1-1fe679c805d1 tempest-ProjectReaderTests-412960283 None] Created volume successfully. Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] Creating offline snapshot 57b3226f-3e64-47df-9174-b09eddc88ede of volume a290810f-bbb9-420e-ba21-0692ce17e0f7 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cb79de-08b7-410e-bf3c-c55572dbe464]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Acquiring lock "cinder-37226c16-0a95-495f-8e65-8ab57c4c6eda-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Lock "cinder-37226c16-0a95-495f-8e65-8ab57c4c6eda-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Acquiring lock "cinder-quobyte-37226c16-0a95-495f-8e65-8ab57c4c6eda" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Lock "cinder-quobyte-37226c16-0a95-495f-8e65-8ab57c4c6eda" acquired by "delete_volume" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e8441e-0e62-495a-a40d-37b47b21ac15]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-37226c16-0a95-495f-8e65-8ab57c4c6eda {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:17 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 Sep 21 16:58:17 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:17 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-37226c16-0a95-495f-8e65-8ab57c4c6eda Sep 21 16:58:17 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:17 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7" returned: 0 in 0.436s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:17 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede 1G Sep 21 16:58:17 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:17 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-37226c16-0a95-495f-8e65-8ab57c4c6eda" returned: 0 in 0.406s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-37226c16-0a95-495f-8e65-8ab57c4c6eda {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:17 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-37226c16-0a95-495f-8e65-8ab57c4c6eda Sep 21 16:58:17 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:17 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-37226c16-0a95-495f-8e65-8ab57c4c6eda" returned: 0 in 0.284s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:17 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Lock "cinder-quobyte-37226c16-0a95-495f-8e65-8ab57c4c6eda" released by "delete_volume" :: held 0.740s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Created reservations ['105bd16c-6fee-4f17-af64-9f19a59c5921', '0bbec9de-7720-4b0c-913a-8a23c66cbb8c', 'ea78f08d-586c-48fe-8ad6-f214b0d1e016', '9d5ddf3b-1d18-4417-b17c-5d569b8f1823'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:18 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede 1G" returned: 0 in 0.522s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:18 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede Sep 21 16:58:18 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:18 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:58:18 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:18 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.271s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:18 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede" returned: 0 in 0.324s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:18 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede is being set with open permissions: ugo+rw Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:18 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Deleted volume successfully. Sep 21 16:58:18 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede Sep 21 16:58:18 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-67b01d83-c973-4718-8cc8-0d4d7138521b tempest-ProjectReaderTests-412960283 None] Lock "cinder-37226c16-0a95-495f-8e65-8ab57c4c6eda-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:18 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede" returned: 0 in 0.288s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:18 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.info Sep 21 16:58:18 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Flow 'volume_create_manager' (d5dac888-a48f-4e2a-9fec-e5678ed5e721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83f29f6-f8aa-4454-95be-837d44eeef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83f29f6-f8aa-4454-95be-837d44eeef13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2101092926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087ce853-6021-4550-8ff3-0061411c80a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8489ea44c5347259f1c55794b91ac8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:19Z,use_quota=True,user_id='312612552fe34fec878440052b6431f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b439837-d687-4fa3-bee5-0b31344e450d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b439837-d687-4fa3-bee5-0b31344e450d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50024f5c-d3c6-49be-a6c4-d277da38ff74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50024f5c-d3c6-49be-a6c4-d277da38ff74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '087ce853-6021-4550-8ff3-0061411c80a9', 'volume_name': 'volume-087ce853-6021-4550-8ff3-0061411c80a9', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:18 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403ed4c8-c2a8-436c-a9e8-8106f7a4a838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403ed4c8-c2a8-436c-a9e8-8106f7a4a838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24307879-d918-4aff-8ef9-a4ec3b813302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:19 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Volume 087ce853-6021-4550-8ff3-0061411c80a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-087ce853-6021-4550-8ff3-0061411c80a9', 'volume_size': 1} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:19 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.info" returned: 0 in 0.324s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:19 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.info is being set with open permissions: ugo+rw Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:19 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.info Sep 21 16:58:19 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:19 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.info" returned: 0 in 0.276s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2101092926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087ce853-6021-4550-8ff3-0061411c80a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8489ea44c5347259f1c55794b91ac8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:19Z,use_quota=True,user_id='312612552fe34fec878440052b6431f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Creating volume 087ce853-6021-4550-8ff3-0061411c80a9 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:58:19 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-087ce853-6021-4550-8ff3-0061411c80a9 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:19 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-087ce853-6021-4550-8ff3-0061411c80a9 1073741824 Sep 21 16:58:19 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:19 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d711976c-dace-45fc-bec5-ce6a99d482ad tempest-ProjectMemberTests-1629542409 None] Create snapshot completed successfully Sep 21 16:58:19 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-087ce853-6021-4550-8ff3-0061411c80a9 1073741824" returned: 0 in 0.565s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=153,cinder:UPDATE=176,cinder:INSERT=50,cinder:DELETE=21 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=139,cinder:INSERT=54,cinder:UPDATE=182,cinder:DELETE=9 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:58:19 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-087ce853-6021-4550-8ff3-0061411c80a9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:19 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-087ce853-6021-4550-8ff3-0061411c80a9 Sep 21 16:58:19 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:20 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-087ce853-6021-4550-8ff3-0061411c80a9" returned: 0 in 0.262s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24307879-d918-4aff-8ef9-a4ec3b813302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087ce853-6021-4550-8ff3-0061411c80a9', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364a46d2-cb0b-4d92-a32b-0a19083e7a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:20 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Volume volume-087ce853-6021-4550-8ff3-0061411c80a9 (087ce853-6021-4550-8ff3-0061411c80a9): created successfully Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364a46d2-cb0b-4d92-a32b-0a19083e7a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Flow 'volume_create_manager' (d5dac888-a48f-4e2a-9fec-e5678ed5e721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-57b3226f-3e64-47df-9174-b09eddc88ede-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:20 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c54a9c9f-2e53-4be1-a6d7-4d2201a089a0 tempest-ProjectReaderTests-412960283 None] Created volume successfully. Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Lock "cinder-57b3226f-3e64-47df-9174-b09eddc88ede-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-a290810f-bbb9-420e-ba21-0692ce17e0f7" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-a290810f-bbb9-420e-ba21-0692ce17e0f7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-57b3226f-3e64-47df-9174-b09eddc88ede" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-57b3226f-3e64-47df-9174-b09eddc88ede" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Deleting offline snapshot 57b3226f-3e64-47df-9174-b09eddc88ede of volume a290810f-bbb9-420e-ba21-0692ce17e0f7 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] snapshot_file for this snap is: volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[10291302-f0bf-4cc4-846d-fdaa9840d0e7]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:20 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede Sep 21 16:58:20 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:20 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede" returned: 0 in 0.394s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a290810f-bbb9-420e-ba21-0692ce17e0f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4588629c-fbc5-4bac-827b-effb91d0df78]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:20 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:20 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 Sep 21 16:58:20 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Acquiring lock "cinder-087ce853-6021-4550-8ff3-0061411c80a9-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Lock "cinder-087ce853-6021-4550-8ff3-0061411c80a9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Acquiring lock "cinder-quobyte-087ce853-6021-4550-8ff3-0061411c80a9" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Lock "cinder-quobyte-087ce853-6021-4550-8ff3-0061411c80a9" acquired by "delete_volume" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d06b0c6-42e2-4e85-a00e-79e35f2c242c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-087ce853-6021-4550-8ff3-0061411c80a9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:21 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7" returned: 0 in 0.424s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:21 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-087ce853-6021-4550-8ff3-0061411c80a9 Sep 21 16:58:21 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:21 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede Sep 21 16:58:21 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:21 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-087ce853-6021-4550-8ff3-0061411c80a9" returned: 0 in 0.411s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-087ce853-6021-4550-8ff3-0061411c80a9 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:21 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-087ce853-6021-4550-8ff3-0061411c80a9 Sep 21 16:58:21 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:21 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede" returned: 0 in 0.392s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:21 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede Sep 21 16:58:21 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:21 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-087ce853-6021-4550-8ff3-0061411c80a9" returned: 0 in 0.286s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Lock "cinder-quobyte-087ce853-6021-4550-8ff3-0061411c80a9" released by "delete_volume" :: held 0.763s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Created reservations ['d635df69-39b6-4082-aef5-6b673299d24c', 'aa180a58-f865-4657-8723-4934e45fd065', '06d7146b-3e87-4735-b5f2-cd981e2b8c3c', '23e36120-29e3-4c36-8099-dbe04e39e35d'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:21 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7.57b3226f-3e64-47df-9174-b09eddc88ede" returned: 0 in 0.288s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-57b3226f-3e64-47df-9174-b09eddc88ede" released by "_delete_snapshot" :: held 1.620s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:21 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-a290810f-bbb9-420e-ba21-0692ce17e0f7" released by "delete_snapshot" :: held 1.647s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:22 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:58:22 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Created reservations ['4e6ba78e-e04e-4abc-a818-f1416058c9dc', 'e577f083-a5fb-4054-a3af-38ed8a04596c', '5e64a1d7-b10c-4a0b-b1b8-48aa3cc2c805', '9966e866-30d1-4367-89ee-2cae84599a1a'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:22 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Delete snapshot completed successfully. Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-f4efca77-b364-4b23-9be7-d22359a8bb0f tempest-ProjectMemberTests-1629542409 None] Lock "cinder-57b3226f-3e64-47df-9174-b09eddc88ede-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:22 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.267s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:58:22 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Deleted volume successfully. Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-7da05833-6773-45f2-9999-736ee88c0d41 tempest-ProjectReaderTests-412960283 None] Lock "cinder-087ce853-6021-4550-8ff3-0061411c80a9-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-a290810f-bbb9-420e-ba21-0692ce17e0f7-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-a290810f-bbb9-420e-ba21-0692ce17e0f7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-a290810f-bbb9-420e-ba21-0692ce17e0f7" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-a290810f-bbb9-420e-ba21-0692ce17e0f7" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7f9a95-6531-4cbf-aaa8-cff4bb41171e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Flow 'volume_create_manager' (78cc1570-b39c-4acd-8ac8-ee28e252c27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:22 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 Sep 21 16:58:22 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cf75b0-c328-49d1-a641-0b781925a4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cf75b0-c328-49d1-a641-0b781925a4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1515833915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b97ca8-d584-4ef1-b838-80dea1f4bb4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8489ea44c5347259f1c55794b91ac8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:23Z,use_quota=True,user_id='312612552fe34fec878440052b6431f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46a88d4-99e1-41f1-80cb-a2333edb01f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46a88d4-99e1-41f1-80cb-a2333edb01f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08aa2450-7edc-496a-89b5-bc98e894d55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08aa2450-7edc-496a-89b5-bc98e894d55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0b97ca8-d584-4ef1-b838-80dea1f4bb4b', 'volume_name': 'volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22958d34-5432-432f-8b54-051a5d3d5aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22958d34-5432-432f-8b54-051a5d3d5aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10beb466-ef75-4513-baf0-dd6cdb11e923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:22 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Volume f0b97ca8-d584-4ef1-b838-80dea1f4bb4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b', 'volume_size': 1} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1515833915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b97ca8-d584-4ef1-b838-80dea1f4bb4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8489ea44c5347259f1c55794b91ac8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:23Z,use_quota=True,user_id='312612552fe34fec878440052b6431f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Creating volume f0b97ca8-d584-4ef1-b838-80dea1f4bb4b {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:58:22 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:22 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b 1073741824 Sep 21 16:58:22 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:22 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7" returned: 0 in 0.389s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:22 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:22 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7 Sep 21 16:58:22 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:23 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b 1073741824" returned: 0 in 0.417s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:23 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-a290810f-bbb9-420e-ba21-0692ce17e0f7" returned: 0 in 0.251s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-a290810f-bbb9-420e-ba21-0692ce17e0f7" released by "delete_volume" :: held 0.730s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:23 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b Sep 21 16:58:23 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Created reservations ['1f81ac1b-abab-49e9-a8cb-a78a2f286100', 'da8dc3f1-e9ab-435d-bf74-67a0efaa222c', '83713bda-e982-4c6d-b787-560feb3f39a3', '226a8f28-7f22-4a4e-b521-623df6942ccc'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:23 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:58:23 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:23 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b" returned: 0 in 0.251s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10beb466-ef75-4513-baf0-dd6cdb11e923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afef2fa2-abd3-449a-81b6-d2d2d04b7058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:23 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Volume volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b (f0b97ca8-d584-4ef1-b838-80dea1f4bb4b): created successfully Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afef2fa2-abd3-449a-81b6-d2d2d04b7058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Flow 'volume_create_manager' (78cc1570-b39c-4acd-8ac8-ee28e252c27d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:23 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-63128756-3b74-48ef-acb4-8409a18c2386 tempest-ProjectReaderTests-412960283 None] Created volume successfully. Sep 21 16:58:23 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.268s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:58:23 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Deleted volume successfully. Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-c386d7b0-a1b0-497c-a9f3-dad7377ac082 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-a290810f-bbb9-420e-ba21-0692ce17e0f7-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Acquiring lock "cinder-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Lock "cinder-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Acquiring lock "cinder-quobyte-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Lock "cinder-quobyte-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b" acquired by "delete_volume" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab639ed-83e4-4054-b1cb-8d0fb895ff0a]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:23 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:24 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b Sep 21 16:58:24 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (3fcc406f-26b0-4de8-a9e6-0bb6b5e6264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e7249d-e527-4894-a78c-6abc331679f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e7249d-e527-4894-a78c-6abc331679f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062222836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb81649c-5cd2-4822-a015-ef9ef3708d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:24Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3578574e-ae67-452b-bce0-5b42a24ab21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3578574e-ae67-452b-bce0-5b42a24ab21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702df81b-bcc4-4c51-9d9a-dd245cb567cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702df81b-bcc4-4c51-9d9a-dd245cb567cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb81649c-5cd2-4822-a015-ef9ef3708d97', 'volume_name': 'volume-eb81649c-5cd2-4822-a015-ef9ef3708d97', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c1d09c-f6d9-4a0b-ade8-bcf2f17c6bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c1d09c-f6d9-4a0b-ade8-bcf2f17c6bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b63f12-b4dd-4a04-a0ca-ebecbbd0616c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:24 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Volume eb81649c-5cd2-4822-a015-ef9ef3708d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb81649c-5cd2-4822-a015-ef9ef3708d97', 'volume_size': 1} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062222836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb81649c-5cd2-4822-a015-ef9ef3708d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:24Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Creating volume eb81649c-5cd2-4822-a015-ef9ef3708d97 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:58:24 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:24 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 1073741824 Sep 21 16:58:24 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:24 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b" returned: 0 in 0.396s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:24 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b Sep 21 16:58:24 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:24 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b" returned: 0 in 0.250s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Lock "cinder-quobyte-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b" released by "delete_volume" :: held 0.700s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Created reservations ['3a38cc4c-da1d-4257-adb8-f35751e2c742', 'e4490429-9767-4b74-8d03-d20d4f4b484f', '007a0c28-47bf-48cb-a970-db359d1ca0e7', 'dc762099-d95a-488d-b78f-c79ca7310b41'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:24 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 1073741824" returned: 0 in 0.464s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:24 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 Sep 21 16:58:24 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:24 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:58:24 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:24 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97" returned: 0 in 0.256s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:58:24 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b63f12-b4dd-4a04-a0ca-ebecbbd0616c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb81649c-5cd2-4822-a015-ef9ef3708d97', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632cbf4b-6517-4a46-a889-912b1f526049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:25 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:25 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Volume volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 (eb81649c-5cd2-4822-a015-ef9ef3708d97): created successfully Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632cbf4b-6517-4a46-a889-912b1f526049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (3fcc406f-26b0-4de8-a9e6-0bb6b5e6264f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.281s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:58:25 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Deleted volume successfully. Sep 21 16:58:25 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3c560bcb-655a-4e1e-8a0c-d071d43c8795 tempest-ProjectMemberTests-1629542409 None] Created volume successfully. Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-64478116-2277-443c-93d4-82028a7ad6d4 tempest-ProjectReaderTests-412960283 None] Lock "cinder-f0b97ca8-d584-4ef1-b838-80dea1f4bb4b-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Flow 'volume_create_manager' (5beebcf3-a34d-491f-b3b3-606fd0c9c2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062dc0c6-a46d-46f4-af71-f703b74b6673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062dc0c6-a46d-46f4-af71-f703b74b6673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758680896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175a6fb7-af6a-4385-b4f5-db06709f5eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8489ea44c5347259f1c55794b91ac8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:25Z,use_quota=True,user_id='312612552fe34fec878440052b6431f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47fe6918-1b39-4d12-af5c-1e1a99202bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47fe6918-1b39-4d12-af5c-1e1a99202bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81043b90-bd66-4c84-8cd1-3ff13506c5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81043b90-bd66-4c84-8cd1-3ff13506c5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '175a6fb7-af6a-4385-b4f5-db06709f5eee', 'volume_name': 'volume-175a6fb7-af6a-4385-b4f5-db06709f5eee', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6eeb8c-d0b1-47ce-b897-1455a8ccc16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6eeb8c-d0b1-47ce-b897-1455a8ccc16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6657e916-e403-4c54-950b-9d90b5ffd5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:25 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Volume 175a6fb7-af6a-4385-b4f5-db06709f5eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-175a6fb7-af6a-4385-b4f5-db06709f5eee', 'volume_size': 1} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758680896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175a6fb7-af6a-4385-b4f5-db06709f5eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8489ea44c5347259f1c55794b91ac8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:25Z,use_quota=True,user_id='312612552fe34fec878440052b6431f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Creating volume 175a6fb7-af6a-4385-b4f5-db06709f5eee {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:58:25 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-175a6fb7-af6a-4385-b4f5-db06709f5eee 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:25 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-175a6fb7-af6a-4385-b4f5-db06709f5eee 1073741824 Sep 21 16:58:25 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:25 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-175a6fb7-af6a-4385-b4f5-db06709f5eee 1073741824" returned: 0 in 0.401s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:25 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-175a6fb7-af6a-4385-b4f5-db06709f5eee {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:25 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-175a6fb7-af6a-4385-b4f5-db06709f5eee Sep 21 16:58:25 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:26 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-175a6fb7-af6a-4385-b4f5-db06709f5eee" returned: 0 in 0.254s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6657e916-e403-4c54-950b-9d90b5ffd5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-175a6fb7-af6a-4385-b4f5-db06709f5eee', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1b1085-ecbf-453d-be12-453f8018afc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:26 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Volume volume-175a6fb7-af6a-4385-b4f5-db06709f5eee (175a6fb7-af6a-4385-b4f5-db06709f5eee): created successfully Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1b1085-ecbf-453d-be12-453f8018afc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Flow 'volume_create_manager' (5beebcf3-a34d-491f-b3b3-606fd0c9c2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:26 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8d640c48-ba5d-459f-9a9f-0b68216ed406 tempest-ProjectReaderTests-412960283 None] Created volume successfully. Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] Creating offline snapshot c04a3a92-a149-47de-9f03-5f39cc61975b of volume eb81649c-5cd2-4822-a015-ef9ef3708d97 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2665e2a6-f653-4117-836b-97c8d94732f4]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Acquiring lock "cinder-175a6fb7-af6a-4385-b4f5-db06709f5eee-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Lock "cinder-175a6fb7-af6a-4385-b4f5-db06709f5eee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:26 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 Sep 21 16:58:26 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Acquiring lock "cinder-quobyte-175a6fb7-af6a-4385-b4f5-db06709f5eee" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Lock "cinder-quobyte-175a6fb7-af6a-4385-b4f5-db06709f5eee" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6715c34-7fd3-47ea-855e-f975505e5f59]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-175a6fb7-af6a-4385-b4f5-db06709f5eee {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:26 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-175a6fb7-af6a-4385-b4f5-db06709f5eee Sep 21 16:58:26 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:26 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97" returned: 0 in 0.394s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:26 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b 1G Sep 21 16:58:26 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:26 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-175a6fb7-af6a-4385-b4f5-db06709f5eee" returned: 0 in 0.381s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:26 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-175a6fb7-af6a-4385-b4f5-db06709f5eee {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:26 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-175a6fb7-af6a-4385-b4f5-db06709f5eee Sep 21 16:58:26 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:27 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b 1G" returned: 0 in 0.400s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:27 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b Sep 21 16:58:27 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:27 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-175a6fb7-af6a-4385-b4f5-db06709f5eee" returned: 0 in 0.277s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Lock "cinder-quobyte-175a6fb7-af6a-4385-b4f5-db06709f5eee" released by "delete_volume" :: held 0.703s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Created reservations ['1070686a-5906-4767-bad4-c19143092b8b', 'ce110b88-08df-4105-9ad3-254831b2c728', 'de8856ce-e02e-4a20-b687-767ad51cbdb3', '300ff653-ef15-4418-b0c9-ff0f740339c3'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:27 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:58:27 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:27 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b" returned: 0 in 0.302s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:27 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b is being set with open permissions: ugo+rw Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:27 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b Sep 21 16:58:27 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:27 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.275s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:58:27 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Deleted volume successfully. Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-9ba759af-7304-43b3-9e29-1ae25cb96b19 tempest-ProjectReaderTests-412960283 None] Lock "cinder-175a6fb7-af6a-4385-b4f5-db06709f5eee-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:27 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b" returned: 0 in 0.256s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:27 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:27 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.info Sep 21 16:58:27 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:28 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.info" returned: 0 in 0.263s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:28 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.info is being set with open permissions: ugo+rw Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:28 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.info Sep 21 16:58:28 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:28 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.info" returned: 0 in 0.254s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:28 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-b7f09eb9-aec7-44eb-bc8a-7e01a11dd2a8 tempest-ProjectMemberTests-1629542409 None] Create snapshot completed successfully Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-c04a3a92-a149-47de-9f03-5f39cc61975b-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-c04a3a92-a149-47de-9f03-5f39cc61975b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-eb81649c-5cd2-4822-a015-ef9ef3708d97" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-eb81649c-5cd2-4822-a015-ef9ef3708d97" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-c04a3a92-a149-47de-9f03-5f39cc61975b" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-c04a3a92-a149-47de-9f03-5f39cc61975b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Deleting offline snapshot c04a3a92-a149-47de-9f03-5f39cc61975b of volume eb81649c-5cd2-4822-a015-ef9ef3708d97 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] snapshot_file for this snap is: volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7e3eef-b71e-4c26-9c46-1779ddbd9e7d]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:28 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b Sep 21 16:58:28 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:28 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b" returned: 0 in 0.382s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:28 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb81649c-5cd2-4822-a015-ef9ef3708d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:58:29 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2616dafc-6885-44ce-ae8f-ad09c5afe20f]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:29 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 Sep 21 16:58:29 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:29 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97" returned: 0 in 0.384s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:29 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b Sep 21 16:58:29 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:29 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b" returned: 0 in 0.330s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:29 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:29 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b Sep 21 16:58:29 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:29 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97.c04a3a92-a149-47de-9f03-5f39cc61975b" returned: 0 in 0.249s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-c04a3a92-a149-47de-9f03-5f39cc61975b" released by "_delete_snapshot" :: held 1.467s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-eb81649c-5cd2-4822-a015-ef9ef3708d97" released by "delete_snapshot" :: held 1.495s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:30 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Created reservations ['ad3e769c-9812-4459-a7dd-9f96fd44f500', '4e2c0f48-67ad-4a67-86f8-dac04ec5f8ff', 'a98b9ef4-ed30-4784-84fe-e5c07842c0a6', '2f06f0ec-2a14-429f-b5e4-93a032464924'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:30 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Delete snapshot completed successfully. Sep 21 16:58:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-2a03828b-0ae9-4302-89e1-c4e1b3262180 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-c04a3a92-a149-47de-9f03-5f39cc61975b-delete_snapshot" released by "delete_snapshot" :: held 1.637s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-eb81649c-5cd2-4822-a015-ef9ef3708d97-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-eb81649c-5cd2-4822-a015-ef9ef3708d97-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-eb81649c-5cd2-4822-a015-ef9ef3708d97" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:30 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-eb81649c-5cd2-4822-a015-ef9ef3708d97" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:30 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77454fb-ec25-406e-8749-2ac32a9d22f3]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:30 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:30 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 Sep 21 16:58:30 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:31 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97" returned: 0 in 0.360s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:31 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97 Sep 21 16:58:31 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:31 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-eb81649c-5cd2-4822-a015-ef9ef3708d97" returned: 0 in 0.247s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-eb81649c-5cd2-4822-a015-ef9ef3708d97" released by "delete_volume" :: held 0.667s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Created reservations ['4dac1320-7324-4618-a5ab-c757d115a5f8', '9973eeca-982b-4d1f-af3e-722b328f84c4', 'e94a890d-1410-4ec8-926e-e1c5ac0d5591', 'a72d46f6-1632-45b3-a810-4223c3ab04d7'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:31 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:58:31 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:31 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.250s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:58:31 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Deleted volume successfully. Sep 21 16:58:31 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-559ff2fc-9b23-47e4-8c76-b2c55377d531 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-eb81649c-5cd2-4822-a015-ef9ef3708d97-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (ac30bd84-b230-498a-a64a-cc7fdfce469a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fdd611-5789-48a9-bccf-5749fcc8de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fdd611-5789-48a9-bccf-5749fcc8de06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235783839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444a469a-500d-4e00-ad59-15dcdaa9c68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:32Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5299824-c1ad-4f20-8552-8a9a560d407a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5299824-c1ad-4f20-8552-8a9a560d407a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74c0d9b-5aea-4fff-90c7-b3f54dc33e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74c0d9b-5aea-4fff-90c7-b3f54dc33e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '444a469a-500d-4e00-ad59-15dcdaa9c68a', 'volume_name': 'volume-444a469a-500d-4e00-ad59-15dcdaa9c68a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a96277b-eb71-494b-83f8-660d6d87ea59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a96277b-eb71-494b-83f8-660d6d87ea59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd852e6-8911-421a-b455-b7d0cdeb61e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:32 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Volume 444a469a-500d-4e00-ad59-15dcdaa9c68a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-444a469a-500d-4e00-ad59-15dcdaa9c68a', 'volume_size': 1} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235783839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444a469a-500d-4e00-ad59-15dcdaa9c68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:32Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Creating volume 444a469a-500d-4e00-ad59-15dcdaa9c68a {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:58:32 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:32 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a 1073741824 Sep 21 16:58:32 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:32 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a 1073741824" returned: 0 in 0.451s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:32 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:32 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a Sep 21 16:58:32 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:33 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a" returned: 0 in 0.251s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd852e6-8911-421a-b455-b7d0cdeb61e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-444a469a-500d-4e00-ad59-15dcdaa9c68a', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f46c68-7d21-4fed-b51d-d999507b76f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:33 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Volume volume-444a469a-500d-4e00-ad59-15dcdaa9c68a (444a469a-500d-4e00-ad59-15dcdaa9c68a): created successfully Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f46c68-7d21-4fed-b51d-d999507b76f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (ac30bd84-b230-498a-a64a-cc7fdfce469a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:33 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-c5fbb24b-7c69-48e0-91f4-499c3ece357c tempest-ProjectMemberTests-1629542409 None] Created volume successfully. Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] Creating offline snapshot 704ad1ab-242d-4cf7-8346-f6adb77ec515 of volume 444a469a-500d-4e00-ad59-15dcdaa9c68a {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b9bb78-0bef-4998-81ec-8b899cebaff5]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:33 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a Sep 21 16:58:33 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:33 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a" returned: 0 in 0.367s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:33 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:33 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 1G Sep 21 16:58:33 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:34 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 1G" returned: 0 in 0.399s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444a469a-500d-4e00-ad59-15dcdaa9c68a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:34 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444a469a-500d-4e00-ad59-15dcdaa9c68a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 Sep 21 16:58:34 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:34 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444a469a-500d-4e00-ad59-15dcdaa9c68a -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515" returned: 0 in 0.291s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:34 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 is being set with open permissions: ugo+rw Sep 21 16:58:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:34 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 Sep 21 16:58:34 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:34 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515" returned: 0 in 0.250s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:34 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:34 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.info Sep 21 16:58:34 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:35 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.info" returned: 0 in 0.253s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:35 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.info is being set with open permissions: ugo+rw Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:35 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.info Sep 21 16:58:35 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:35 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.info" returned: 0 in 0.242s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:35 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-50f632b7-f277-4a87-a6d7-2c5f57855b72 tempest-ProjectMemberTests-1629542409 None] Create snapshot completed successfully Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-704ad1ab-242d-4cf7-8346-f6adb77ec515-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-704ad1ab-242d-4cf7-8346-f6adb77ec515-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-444a469a-500d-4e00-ad59-15dcdaa9c68a" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-444a469a-500d-4e00-ad59-15dcdaa9c68a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-704ad1ab-242d-4cf7-8346-f6adb77ec515" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-704ad1ab-242d-4cf7-8346-f6adb77ec515" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Deleting offline snapshot 704ad1ab-242d-4cf7-8346-f6adb77ec515 of volume 444a469a-500d-4e00-ad59-15dcdaa9c68a {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] snapshot_file for this snap is: volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bcc562-4ce1-49c7-855d-e1dbbe9e134d]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:35 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 Sep 21 16:58:35 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:35 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515" returned: 0 in 0.361s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-444a469a-500d-4e00-ad59-15dcdaa9c68a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e613c79-523e-4a5f-8c21-347248ae160c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:35 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:36 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a Sep 21 16:58:36 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:36 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a" returned: 0 in 0.355s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:36 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 Sep 21 16:58:36 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:36 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515" returned: 0 in 0.333s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:36 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515 Sep 21 16:58:36 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:36 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:36 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a.704ad1ab-242d-4cf7-8346-f6adb77ec515" returned: 0 in 0.240s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-704ad1ab-242d-4cf7-8346-f6adb77ec515" released by "_delete_snapshot" :: held 1.382s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:36 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-444a469a-500d-4e00-ad59-15dcdaa9c68a" released by "delete_snapshot" :: held 1.403s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:37 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Created reservations ['41af9257-56de-4256-af22-a66f304d4265', '81b6dd85-4102-4f42-b262-204e60756778', '318598fd-436b-48d2-86a2-73ad9f80ffac', '0e1203f5-2b37-49b0-8cfd-c65cb9b8f641'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:37 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Delete snapshot completed successfully. Sep 21 16:58:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-23fb94bd-c473-4fd2-89d6-1c52ce608c69 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-704ad1ab-242d-4cf7-8346-f6adb77ec515-delete_snapshot" released by "delete_snapshot" :: held 1.540s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-444a469a-500d-4e00-ad59-15dcdaa9c68a-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Lock "cinder-444a469a-500d-4e00-ad59-15dcdaa9c68a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-444a469a-500d-4e00-ad59-15dcdaa9c68a" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:37 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-444a469a-500d-4e00-ad59-15dcdaa9c68a" acquired by "delete_volume" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:37 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f14826-7fd9-47df-8023-3c7cfd47dc9e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:37 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:37 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a Sep 21 16:58:37 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:38 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a" returned: 0 in 0.350s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:38 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a Sep 21 16:58:38 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:38 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-444a469a-500d-4e00-ad59-15dcdaa9c68a" returned: 0 in 0.245s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-444a469a-500d-4e00-ad59-15dcdaa9c68a" released by "delete_volume" :: held 0.655s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Created reservations ['4a69040f-9302-4c86-bd1b-0d9c9b671f84', '0f86e088-3218-4f6c-a219-715477968b95', '9c20d064-591e-49f4-bcf9-38e9c83a9000', '7106fc95-6c56-4074-956f-b4622df5aac6'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:38 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:58:38 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:38 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.250s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:58:38 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Deleted volume successfully. Sep 21 16:58:38 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-180f1a5a-0b22-4e62-bcdd-0995e9e553eb tempest-ProjectMemberTests-1629542409 None] Lock "cinder-444a469a-500d-4e00-ad59-15dcdaa9c68a-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (046c7160-1b28-4244-8680-d47abff34a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02ba210-fe16-4548-a427-5a1eb2d34c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02ba210-fe16-4548-a427-5a1eb2d34c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1378072628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d180ac-500b-4654-8e57-da774d3e77f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:39Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671b9db0-f5ad-499f-b85b-a34dc731c425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671b9db0-f5ad-499f-b85b-a34dc731c425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebd79f2-e844-42e5-a913-a6c12cd3296a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebd79f2-e844-42e5-a913-a6c12cd3296a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d180ac-500b-4654-8e57-da774d3e77f0', 'volume_name': 'volume-f5d180ac-500b-4654-8e57-da774d3e77f0', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082a5d6e-dcfc-425d-8870-5ccd0a59ad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082a5d6e-dcfc-425d-8870-5ccd0a59ad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0240d0f6-a823-4304-882a-5c65bb58f294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:39 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Volume f5d180ac-500b-4654-8e57-da774d3e77f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d180ac-500b-4654-8e57-da774d3e77f0', 'volume_size': 1} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1378072628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d180ac-500b-4654-8e57-da774d3e77f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:39Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Creating volume f5d180ac-500b-4654-8e57-da774d3e77f0 {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:58:39 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:39 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0 1073741824 Sep 21 16:58:39 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:39 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0 1073741824" returned: 0 in 0.408s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:39 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:39 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0 Sep 21 16:58:39 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:40 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0" returned: 0 in 0.247s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0240d0f6-a823-4304-882a-5c65bb58f294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d180ac-500b-4654-8e57-da774d3e77f0', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4519aeff-dd8d-4478-bd47-10203965950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:40 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Volume volume-f5d180ac-500b-4654-8e57-da774d3e77f0 (f5d180ac-500b-4654-8e57-da774d3e77f0): created successfully Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4519aeff-dd8d-4478-bd47-10203965950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (046c7160-1b28-4244-8680-d47abff34a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:40 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-8cd36f8e-5d07-4b52-bcdf-859d8264520d tempest-ProjectMemberTests-1629542409 None] Created volume successfully. Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] Creating offline snapshot 6d3027ce-00f6-4e5d-9969-e43c6762100b of volume f5d180ac-500b-4654-8e57-da774d3e77f0 {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e8bcb6-17bc-4ae8-83ed-750c75823a0e]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:40 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0 Sep 21 16:58:40 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:40 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0" returned: 0 in 0.358s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:40 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:40 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b 1G Sep 21 16:58:40 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:41 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b 1G" returned: 0 in 0.387s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d180ac-500b-4654-8e57-da774d3e77f0 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:41 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d180ac-500b-4654-8e57-da774d3e77f0 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b Sep 21 16:58:41 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:41 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d180ac-500b-4654-8e57-da774d3e77f0 -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b" returned: 0 in 0.295s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:41 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b is being set with open permissions: ugo+rw Sep 21 16:58:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:41 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b Sep 21 16:58:41 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:41 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b" returned: 0 in 0.238s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:41 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.info Sep 21 16:58:41 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:41 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:41 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.info" returned: 0 in 0.252s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:41 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.info is being set with open permissions: ugo+rw Sep 21 16:58:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:42 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.info Sep 21 16:58:42 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:42 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.info" returned: 0 in 0.240s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:42 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3c5c312f-8958-4537-97af-01d8705d7cc7 tempest-ProjectMemberTests-1629542409 None] Create snapshot completed successfully Sep 21 16:58:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-6d3027ce-00f6-4e5d-9969-e43c6762100b-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-6d3027ce-00f6-4e5d-9969-e43c6762100b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-f5d180ac-500b-4654-8e57-da774d3e77f0" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-f5d180ac-500b-4654-8e57-da774d3e77f0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-6d3027ce-00f6-4e5d-9969-e43c6762100b" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:42 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-6d3027ce-00f6-4e5d-9969-e43c6762100b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Deleting offline snapshot 6d3027ce-00f6-4e5d-9969-e43c6762100b of volume f5d180ac-500b-4654-8e57-da774d3e77f0 {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:58:42 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] snapshot_file for this snap is: volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:58:42 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aea445-f306-4be9-ac66-8e8d3a37e837]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:42 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:42 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b Sep 21 16:58:42 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:43 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b" returned: 0 in 0.375s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:43 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5d180ac-500b-4654-8e57-da774d3e77f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:58:43 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e13efa-5499-42fd-9383-36c5caf8d9bd]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:43 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0 Sep 21 16:58:43 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:43 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0" returned: 0 in 0.380s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:43 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b Sep 21 16:58:43 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:43 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b" returned: 0 in 0.332s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:43 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b Sep 21 16:58:43 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:43 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:43 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0.6d3027ce-00f6-4e5d-9969-e43c6762100b" returned: 0 in 0.243s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-6d3027ce-00f6-4e5d-9969-e43c6762100b" released by "_delete_snapshot" :: held 1.428s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-f5d180ac-500b-4654-8e57-da774d3e77f0" released by "delete_snapshot" :: held 1.448s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:44 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Created reservations ['2facea06-9b5b-4b9e-9cbe-a772cee9718c', '3f86e6d8-7f9c-4597-8dc9-905fcaa2261a', '4fc8c272-b6de-41cd-810a-6de468c1b816', '30953bc6-cda4-402a-b86f-cb5c806ae70c'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:44 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Delete snapshot completed successfully. Sep 21 16:58:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-01ce3aed-a853-4c3e-bae9-3b2de0449ef7 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-6d3027ce-00f6-4e5d-9969-e43c6762100b-delete_snapshot" released by "delete_snapshot" :: held 1.578s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-f5d180ac-500b-4654-8e57-da774d3e77f0-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Lock "cinder-f5d180ac-500b-4654-8e57-da774d3e77f0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-f5d180ac-500b-4654-8e57-da774d3e77f0" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:44 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-f5d180ac-500b-4654-8e57-da774d3e77f0" acquired by "delete_volume" :: waited 0.015s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:44 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc5e7c8-28bb-44b4-a0da-5a1ba2a059bf]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:44 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:44 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0 Sep 21 16:58:44 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:45 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0" returned: 0 in 0.356s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:45 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0 Sep 21 16:58:45 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:45 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f5d180ac-500b-4654-8e57-da774d3e77f0" returned: 0 in 0.243s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-f5d180ac-500b-4654-8e57-da774d3e77f0" released by "delete_volume" :: held 0.659s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Created reservations ['a1b3ee25-294d-482e-bf30-99f8d3b2d0aa', 'dedb3aef-2879-4fe2-9407-4d18720397f5', '945de193-9e2f-483c-8415-a3e83af74bca', '49768f6e-fc0b-447a-87ec-ddd9f90e7fb0'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:45 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:58:45 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:45 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.281s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:58:45 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Deleted volume successfully. Sep 21 16:58:45 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-0e73516c-37cf-4a2e-a253-a3a309d9238d tempest-ProjectMemberTests-1629542409 None] Lock "cinder-f5d180ac-500b-4654-8e57-da774d3e77f0-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86030) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (e3276a8f-3c7b-49e7-832a-23baccf61274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02289822-e99c-4e32-ba02-81d2eaa10393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02289822-e99c-4e32-ba02-81d2eaa10393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980155676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82ec6b7-dc92-45a1-b935-2232a221ed3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:46Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec530fc8-54a2-4e3a-8757-45c626c867a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec530fc8-54a2-4e3a-8757-45c626c867a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d63182-5b31-419d-8ee4-ed634b5d4bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d63182-5b31-419d-8ee4-ed634b5d4bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f82ec6b7-dc92-45a1-b935-2232a221ed3c', 'volume_name': 'volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1959d8dd-a9bc-4629-a51f-05d8835245b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1959d8dd-a9bc-4629-a51f-05d8835245b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a759a3-904e-45a3-9a26-019d080a5389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:46 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Volume f82ec6b7-dc92-45a1-b935-2232a221ed3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c', 'volume_size': 1} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T14:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980155676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82ec6b7-dc92-45a1-b935-2232a221ed3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f9013132914343a633ffa431a2255b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T14:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T14:58:46Z,use_quota=True,user_id='c51a37eb926a412e89483ed9bfa26ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83efb2cf-66bb-43e3-9c6f-d02d372a293b),volume_type_id=83efb2cf-66bb-43e3-9c6f-d02d372a293b)}" {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Creating volume f82ec6b7-dc92-45a1-b935-2232a221ed3c {{(pid=86030) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Selected osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad as target Quobyte volume. {{(pid=86030) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 16:58:46 devstack cinder-volume[86030]: INFO cinder.volume.drivers.remotefs [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] casted to osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c 1073741824 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:46 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c 1073741824 Sep 21 16:58:46 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:46 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c 1073741824" returned: 0 in 0.424s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:46 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:46 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c Sep 21 16:58:46 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:47 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c" returned: 0 in 0.246s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'} {{(pid=86030) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a759a3-904e-45a3-9a26-019d080a5389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c', 'volume_size': 1}' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adb2b68-1af6-4d9c-9413-60186072e049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 16:58:47 devstack cinder-volume[86030]: INFO cinder.volume.flows.manager.create_volume [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Volume volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c (f82ec6b7-dc92-45a1-b935-2232a221ed3c): created successfully Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adb2b68-1af6-4d9c-9413-60186072e049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86030) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Flow 'volume_create_manager' (e3276a8f-3c7b-49e7-832a-23baccf61274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86030) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 16:58:47 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-4f354dd2-4474-405b-b758-e8c6a54220a9 tempest-ProjectMemberTests-1629542409 None] Created volume successfully. Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] Creating offline snapshot 86a28956-3cee-4573-af91-76cdae4643ac of volume f82ec6b7-dc92-45a1-b935-2232a221ed3c {{(pid=86030) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be588ee-4b9f-4d34-bec2-a546b530260c]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:47 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c Sep 21 16:58:47 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:47 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c" returned: 0 in 0.364s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:47 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac 1G {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:47 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac 1G Sep 21 16:58:47 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:48 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac 1G" returned: 0 in 0.385s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:48 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac Sep 21 16:58:48 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:48 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c -F qcow2 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac" returned: 0 in 0.292s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:48 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac is being set with open permissions: ugo+rw Sep 21 16:58:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:48 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac Sep 21 16:58:48 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:48 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac" returned: 0 in 0.239s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:48 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:48 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.info Sep 21 16:58:48 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:49 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.info" returned: 0 in 0.256s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:49 devstack cinder-volume[86030]: WARNING cinder.volume.drivers.remotefs [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.info is being set with open permissions: ugo+rw Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.info {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:49 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.info Sep 21 16:58:49 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:49 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.info" returned: 0 in 0.249s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:49 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-69caaede-12fa-4fef-814f-64d7d516cc57 tempest-ProjectMemberTests-1629542409 None] Create snapshot completed successfully Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-86a28956-3cee-4573-af91-76cdae4643ac-delete_snapshot" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-86a28956-3cee-4573-af91-76cdae4643ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-f82ec6b7-dc92-45a1-b935-2232a221ed3c" by "delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-f82ec6b7-dc92-45a1-b935-2232a221ed3c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-86a28956-3cee-4573-af91-76cdae4643ac" by "_delete_snapshot" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-86a28956-3cee-4573-af91-76cdae4643ac" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Deleting offline snapshot 86a28956-3cee-4573-af91-76cdae4643ac of volume f82ec6b7-dc92-45a1-b935-2232a221ed3c {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] snapshot_file for this snap is: volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac {{(pid=86030) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be8d1f8-e51a-40ac-9513-e6c1aa711315]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:49 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:49 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac Sep 21 16:58:49 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:50 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac" returned: 0 in 0.379s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:50 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.remotefs [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86030) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 16:58:50 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[716ce6e2-f1e7-4d85-bbdf-8457bbc21af7]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:50 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c Sep 21 16:58:50 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:50 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c" returned: 0 in 0.359s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:50 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac Sep 21 16:58:50 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:50 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac" returned: 0 in 0.344s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:50 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:50 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac Sep 21 16:58:50 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:51 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c.86a28956-3cee-4573-af91-76cdae4643ac" returned: 0 in 0.248s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-86a28956-3cee-4573-af91-76cdae4643ac" released by "_delete_snapshot" :: held 1.425s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-f82ec6b7-dc92-45a1-b935-2232a221ed3c" released by "delete_snapshot" :: held 1.447s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:51 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Created reservations ['883bc822-2bc1-496a-bfb3-e4c0b522ba3a', 'fbf45099-b2d9-4b29-8792-2adf55fad49e', '8b3db4d5-7a45-444d-b46a-e0605233ed76', '3733bc37-1178-440a-ac6f-67e1dbf27f54'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:51 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Delete snapshot completed successfully. Sep 21 16:58:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-d7ea3de7-f587-4744-913f-ab87095356f8 tempest-ProjectMemberTests-1629542409 None] Lock "cinder-86a28956-3cee-4573-af91-76cdae4643ac-delete_snapshot" released by "delete_snapshot" :: held 1.585s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-f82ec6b7-dc92-45a1-b935-2232a221ed3c-delete_volume" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Lock "cinder-f82ec6b7-dc92-45a1-b935-2232a221ed3c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Acquiring lock "cinder-quobyte-f82ec6b7-dc92-45a1-b935-2232a221ed3c" by "delete_volume" {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 16:58:51 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-f82ec6b7-dc92-45a1-b935-2232a221ed3c" acquired by "delete_volume" :: waited 0.013s {{(pid=86030) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 16:58:51 devstack cinder-volume[86030]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe564fcd-cb9c-4034-a258-93423f8412fe]: (4, 'qcow2') {{(pid=87545) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 16:58:51 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:52 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c Sep 21 16:58:52 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:52 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c" returned: 0 in 0.361s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:52 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c Sep 21 16:58:52 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:52 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1/volume-f82ec6b7-dc92-45a1-b935-2232a221ed3c" returned: 0 in 0.246s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:52 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Lock "cinder-quobyte-f82ec6b7-dc92-45a1-b935-2232a221ed3c" released by "delete_volume" :: held 0.669s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:58:52 devstack cinder-volume[86030]: DEBUG cinder.quota [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Created reservations ['80d77642-b22d-4416-942c-83bd2230b978', '043d8bd0-fe97-4e2a-9332-5df42d268375', 'a976f2d6-ea8c-4ac5-a6c2-f05530a627f3', 'ab3d9560-9652-484a-804b-62c66d69d2bb'] {{(pid=86030) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 16:58:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 16:58:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 16:58:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad': None} {{(pid=86030) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 16:58:52 devstack cinder-volume[86030]: DEBUG cinder.volume.drivers.quobyte [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a064e5b7-793d-4a00-b9c8-d0abb722e9ad'] {{(pid=86030) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 16:58:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.lockutils [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86030) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 16:58:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 16:58:52 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1 Sep 21 16:58:52 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 16:58:52 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 21 16:58:52 devstack cinder-volume[86030]: DEBUG oslo_concurrency.processutils [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3424f24fd8e8ce4de7d842ca1b24f6d1" returned: 0 in 0.256s {{(pid=86030) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 16:58:52 devstack cinder-volume[86030]: DEBUG cinder.manager [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Notifying Schedulers of capabilities ... {{(pid=86030) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 16:58:52 devstack cinder-volume[86030]: INFO cinder.volume.manager [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Deleted volume successfully. Sep 21 16:58:53 devstack cinder-volume[86030]: DEBUG cinder.coordination [None req-3e4d7e7b-18fc-4e20-a3fc-a758658489cb tempest-ProjectMemberTests-1629542409 None] Lock "cinder-f82ec6b7-dc92-45a1-b935-2232a221ed3c-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86030) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 16:59:02 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:SELECT=84,cinder:INSERT=33,cinder:UPDATE=117,cinder:DELETE=4 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:59:02 devstack cinder-volume[86030]: DEBUG dbcounter [-] [86030] Writing DB stats cinder:UPDATE=119,cinder:SELECT=87,cinder:INSERT=30,cinder:DELETE=15 {{(pid=86030) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 16:59:07 devstack cinder-volume[86030]: DEBUG oslo_service.periodic_task [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] Running periodic task VolumeManager._thread_info {{(pid=86030) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 16:59:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread count: 29 {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 16:59:07 devstack cinder-volume[86030]: DEBUG cinder.volume.manager [None req-fbf38b08-7e3f-45e8-b471-d9609ea6139f None None] thread info: [<_MainThread(MainThread, started 128932884828288)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86030) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}